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Abstract. It is known that infinitely many Medvedev degrees exist inside the Muchnik degree of any non- 
trivial rij subset of Cantor space. We shed light on the fine structures inside these Muchnik degrees related 
to Learning Theory, Constructive Mathematics, and Computability Theory for discontinuous functions. 
First of all, we classify nonuniformly computable functions on Baire space from the viewpoint of Learn- 
ing Theory, and then we investigate separation techniques to these classes in the strongest sense possible. 
By applying these techniques, among other results, we show that every nonzero Medvedev degree of 
sets has the strong anti-cupping property, and that the law of excluded middle (Ej-LEM) is sufficient to 
transform each 3-valued diagonally noncomputable function (DNR3) into a 2-valued diagonally noncom- 
putable function (DNR2), whereas neither the double negation elimination (Z2-DNE) nor the Ej lessor 
limited principle of omniscience (ESJ-LLPO) is sufficient. We also give characterizations of our classes of 
nonuniformly computable functions by piecewise computability, constructive principle, and Wadge games. 



1. Summary 

1.1. Introduction. To formulate a semantics for intuitionistic propositional calculus, Kolmogorov tried 
to interpret each proposition as a problem. Medvedev [49] formalized his idea by interpreting each 
proposition p as a mass problem |[;?]] c N*^. Under the interpretation, p is provable if is 

witnessed algorithmically, i.e., [[/jj contains a computable element. Formally, P c is Medvedev 
reducible to Q Q if there is a computable function O : 2 — > P. The degree structure induced by the 
Medvedev reduction forms a Brouwer algebra (the dual of a Heyting algebra). Therefore, for instance, 
the (intuitionistic) disjunction is interpreted as some binary operation on the subsets of Baire space which 
realizes the infimum in the Medvedev lattice. 

The Medvedev lattice of nonempty ITj subsets (also called effectively closed or co-c.e. closed subsets) 
of Cantor space 2^ has been widely studied from another perspective unrelated to non-classical logic 
(see Simpson [61]). In this context, Cenzer-Kihara- Weber- Wu [19] found the notion of tree-immunity 
for closed subsets of Cantor space 2^. Their method to prove some theorems on tree-immunity gives 
rise to a kind of "disjunction" under the limit-BHK interpretation of Limit Computable Mathematics [36] 
(abbreviated as LCM), a kind of constructive mathematics based on Learning Theory, whose positive 
arithmetical fragment is captured by Heyting arithmetic with the recursive oj-mle and the Sj law of 
excluded middle [6, 71]. Then the LCM -disjunctions are defined as binary operations on the subsets of 
Baire space. When disjunctive notions are represented as operations on the subsets of Baire space, this 
enable us to compare degrees of difficulty of disjunctive notions. This allows us to formalize the intuition 
that the intuitionistic disjunction is somehow more difficult than the classical one. We then introduce 
the notion of relative leamability for subsets of Baire space by defining the notion of learnability for 
functions on Baire space. They are useful for understanding how does degrees of difficulty of disjunctive 
notions behave. 

Our another motivation is the development and study of computability of discontinuous functions. 
Imagine the floor function [•] : R — > R which is defined by [.tJ = max{?i € Z : n < x}. Although it 
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seems to be easy to draw a rough graph of the floor function [-J, it is not computable since any com- 
putable function must be continuous. Such a seemingly-computable function is usually nonuniformly 
computable, where we say that a function / is nonuniformly computable if the output f(x) is com- 
putable in a given input x. The degree structure induced by nonuniform computability is introduced by 
Muchnik [52], and nonuniformly computability naturally arises in Computable Analysis [12, 81]. Of 
course, most of nonuniformly computable discontinuous functions are far from being computable. Then, 
what kind of discontinuous functions ai^e nearly computable such as the floor function or the step func- 
tion? There have been several challenges [76, 77] to develop computability theory of (nonuniformly 
computable) discontinuous functions by using the notion of leamability. There are also a number of 
approaches to developing computability theory of (nonuniformly computable) discontinuous functions 
(see [15, 80, 79, 78, 81]). In accordance with their attempt and insight, we study various classes of 
nonuniformly computable functions. 

This paper mainly deals with computably-refutable cases: In the situation that a scientist tries to 
verify a statement P, someday he can algorithmically find his verification to be refuted, whenever his 
verification is incorrect. This refutability principle holds only when P is represented as a subset of the 
space. The restriction to IIj subsets of Cantor space 2^ is motivated by several arguments. First of all, 
many mathematical problems can be represented as IT j subsets of certain topological spaces (see Cenzer 
and Remmel [22]). Indeed, the IIj sets in such spaces have become important notions in many branches 
of Computability Theory, such as Recursive Mathematics [31], Reverse Mathematics [64], Computable 
Analysis [75], Effective Randomness [55, 29], and Effective Descriptive Set Theory [50]. Secondly, 
the restriction to 11^ sets can be regarded as an analogy of the Popperian learning [17] because of the 
refutability principle. From these perspective, the universe of 11° sets is expected to be a good playground 
of Learning Theory [38]. Thirdly, degree structures on 11^ subsets of Cantor space 2^ are widely studied 
from the viewpoint of Computability Theory and Reverse Mathematics. Cenzer and Hinman [20] showed 
that the Medvedev degrees of 11 j subsets of Cantor space are dense. Then Simpson [61] asked whether 
the Muchnik degrees of IIj subsets of Cantor space are also dense. However, this question remains open. 
The reason for this might be that, even if A is Muchnik reducible to B (i.e., there is a nonuniformly 
computable function from B to A), this observation does not give us any knowledge about an algorithm 
solving A from a solution of B. Actually, as shown by Simpson-Slaman [66] and Cole-Simpson [25], 
there are infinitely many Medvedev degrees in the Muchnik degree of any nontrivial IIj subsets of Cantor 
space. Our learnability consideration for subsets of Baire space also appears to be in accordance with this 
point of view. In this paper, we shed light on a hidden, but extremely deep structure inside the Muchnik 
degree of each IIj subset of Cantor space. 

1.2. Results. In section 2, we formalize the disjunction operations. Medvedev interpreted the intuition- 
istic disjunction as the direct sum © : ;P(N^) x 'P(N^) 'P(N^). We will introduce the following 
disjunction operations: 

• (The LCM disjunction with mind-changes < n + I) v„+i : P{M^) x 'P(N^) ^ PiM^); 

• (The LCM disjunction) : 'PiW) x ?'(N^); 

• (The classical disjunction) Voo : x P{n^^) !P(N^). 

Then, the direct sum ® is characterized as the LCM disjunction without mind-changes Vi. In the sec- 
tion, we will also introduce the notion of (Qf,/3|y)-computability for partial functions on N*^, for each 
ordinal a,fi,y < co. Then, the notion of (Q',/3|'x)-computability induces just seven classes closed under 
composition. 

• [(£r]} denotes the set of all partial computable functions on N^. 

• [^r]<t<; denotes the set of all partial functions on leai^nable with bounded mind changes. 

• [^7']^|<^ denotes the set of all partial functions on learnable with bounded en^ors. 

• [£7-]^ denotes the set of all partial learnable functions on N*^. 
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• [^t]^'^ denotes the set of all partial fc-wise computable functions on N for some ^ e N. 

• [£7-]^'^ denotes the set of all partial functions on learnable by a team. 

• [^r]^ denotes the set of all partial nonuniformly computable functions on (i.e., all functions 
/ satisfying f{x) <t x for any x € dom(/)). 

These notions are also characterized as piecewise computability. We will see that the following inclusions 
hold. 

C [Srir C 

[COMP] = [Erl! C 1^t]L C [ffrlii,, [^rVJ" C [Erlf = [NONU COMP] 

Here, by [COMP] we denote the set of all partial computable functions on N^, and by [NONU COMP] we 
denote the set of all paitial nonuniformly computable functions on N'^. Our disjunction operations aie 
useful to show that all of the above inclusions are proper Beyond the properness of these inclusions, 
there are four LEVELs signifying the differences between two classes 3f and ® of partial functions on 
(lying between [COMP] and [NONU COMP]). 

(1) There is a function F e g \ (5. 

(2) There are sets X,Y c such that g has a function Fg : X — > F, but ® has no function 
F(5 : X ^ Y. 

(3) There are Hj sets X, F c 2^ such that Fg has a function Fg : X — > F, but F® has no function 
F(5 : X ^ F. 

(4) For every special FIj set F c 2^^, there is a Fl'j' set X c 2^ such that F5 has a function Fg : X ^ F, 
but (5 has no function F® : X ^ F. 

The LEVEL 1 separation just represents 5 ^ (5. Clearly, 4 ^ 3 ^ 2 ^ 1. Note that the LEVEL 2 
separation holds for no sets X, F c N^, since Hj is the first level in the aiithmetical hierarchy which 
can define a nonempty set S c N*^ without computable element. Such a FIj set is called special, i.e., a 
subset of Baire space is special if it is nonempty and contains no computable points. Under Medvedev's 
interpretation, the specialness of ^pj indicates that neither p nor -tpis provable (i.e., p is undecidable). 

In section 3, we study interactions between the disjunction operations and the learnable functions. In 
this way, the LEVEL 3 separations ai^e successful for [£7]}, [£7]^^, [^r]^|<^> and [£7-]^'^. We show that 
there exist IT*' sets P,Qc2^ such that all of the following conditions are satisfied. 

(1) (a) There is no computable function F} : PV2Q — > P^iQ', 

(b) There is a function T^^ : PV2Q — > P^\Q learnable with bounded mind-changes. 

(2) (a) There is no function F<^ : PVa>Q P^iQ learnable with bounded mind-changes; 
(b) There is a function F^|^^ : P^ojQ P^iQ learnable with bounded enws. 

(3) (a) There is no function F^|^^ : PVooQ P^iQ learnable with bounded errors; 
(b) There is a ^-wise computable function F^^ : PWooQ — > P^\Q for some ^ e N. 

The above conditions also suggest how does degrees of difficulty of our disjunction operations behave. 
For instance, (under Medvedev's interpretation) we cannot extract the proof of the intuitionistic disjunc- 
tion of p and q from the proof of the bounded-mind-changes-LCM disjunction of p and q, even if these 
propositions p and q are interpreted as Ff^ sets. 

In contrast to the above results, in section 4, we will see that the hierarchy between [Gr]<^ and [£7]^'^ 
collapses for homogeneous IIj subsets of Cantor space 2^. In other words, the LEVEL 4 separations /a// 
for [Gj-]^^, [£r]^|<^5 and [£7-]^^. For other classes, is the LEVEL 4 separation successful? In most parts 
of section 4, we develop techniques to archive the LEVEL 4 separations. In the section, we introduce 
many well-behaved operators O : PiW'^) — > 'P(N^). The first operator is defined by P 1-^ P~P, the 
concatenation of two closed sets P c N^. Intuitively, the mass problem P~P means that "solve P by a 
learning proof process with mind-change-bound 2". By iterating the concatenation operation, we may 
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introduce the mass problem which means that "solve P by a learning proof process (with a given mind- 
change-bound)". Actually, we will introduce any transfinite iteration of the concatenation operation, 
where a learning proof process with an ordinal bounded mind changes is usually represented as a learning 
proof process along a well-founded tree. We will also introduce a learning proof process along an ill- 
founded tree, which will be called the hyperconcatenation T of closed sets. The hyperconcatenation T 
can be viewed as a special case of a team-learning proof process. 

Our operators turn out to be extremely useful to establish the LEVEL 4 sepai^ation results. Some of 
these results will be proved by applying priority argument inside some learning proof model of P. 

(1) The LEVEL 4 separation succeeds for [Cr]} and [£7-]^^, via the map P i-> P~P. 

(2) The LEVEL 4 separation succeeds for [£7]^^ and [£r]^, via the map 

^ U ■ • ■ ~^''^)- 

meN 

(3) The LEVEL 4 separation succeeds for [£7]^ and [K^]^^, via the map P 1-^ PyP. 

(4) The LEVEL 4 separation succeeds for V^T^tj' ^"^^ ['^rJ^. via the map P Deg(P), where 
Deg(P) denotes the Turing upward closure of P. 

The method we use to show the first item also implies that every nonzero Medvedev degree of TIj 
subsets of Cantor space has the strong anticupping property, i.e., for every nonzero a 6 'P, there is a 
nonzero b e 'P below a such that a ^ b V c for any a ^ c, where the set of all Medvedev degrees of IIj 
subsets of Cantor space is denoted by f. Under Medvedev's interpretation of Intuitionism, our results 
seem to suggest, informally, that any n°-interpreted proposition p is not I PC-derivable from p~p A q 
whenever p is not I PC-derivable from the IT j -interpreted proposition q. Similarly, under Medvedev-style 
mass problem interpretation of LCM, any H^'-interpreted proposition p is not LCM -derivable from pJpAq 
whenever p is not LCM -derivable from the n'j'-inteipreted proposition q. Here, IPC and LCM represent 
intuitionistic propositional caluculas and limit computable mathematics, respectively. 

In section 5, we apply our results to sharpen Jockusch's theorem [43] and Simpson's Embedding 
Lemma [62]. Jockusch showed the following nonuniform computability result for DNRi-, the set of all 
fc- valued diagonally noncomputable functions. 

(1) There is no (uniformly) computable function F} : DNR3 — > DNR2. 

(2) There is a nonuniformly computable function Y'^ : DNR3 — > DNR2. 

This result will be sharpened by using our learnability notions as follows. 

(1) There is no learnable function : DNR3 DNR2. 

(2) There is no ^-wise computable function F^'^ : DNR3 DNR2 for ^ e N. 

(3) There is a (uniformly) computable function F} : DNR3 — > DNR2TDNR2. Hence, there is a 
function F^^ : DNR3 — > DNR2 learnable by a team of two learners. 

In this section, we characterize our classes [£r]^|^ and operations in the context of constructive prin- 
ciple, Borel measurability, and topological games. We will see that how our classes of nonuniformly 
computable functions relate to the arithmetical hierarchy of non-intuitionistic principles such as the law 
of excluded middle (LEM), the lessor limited principle of omniscience or de Morgan's law (LLPO), and 
the double negation elimination (DNE). The arithmetical hierarchy of non-intuitionistic principles is il- 
lustrated as follows: 

/ 20-LLPO \ 
EO-LEM — A°-LEM ' SO-LEM — S°-DNE 

\ Z^-DNE / 

Here, F-LEM represents the sentence ^ V -k/j for F-sentences ip; F-LLPO represents the sentence -i(^ A 
(/r) — > -1^ V -11/' for F-sentences ip, t/f, and F-DNE represents the sentence -i-xp (p for F-sentences (p. 
Of course, in our context (i.e., in classical logic), these principles are provable. However, in some sense. 
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these principles are not computable. For example, the concatenation and [£r]<(j corresponds to Sj-LEM; 
the bounded-error learnability [^t]^^^ is related to Aj-LEM; the learnability corresponds to l.^- 

DNE; [£7-]^'^ is related to E2-LLPO; the hyperconcatenation T is related to E2-LEM; the nonuniform 
computability [K^]^ is related to E^-DNE, and so on. Hence, every DNRs-function can be transformed 
into a DNR2-function whenever we are allowed to use Zj-LEM, whereas neither E2-DNE nor E2-LLPO 
is sufficient to transform each DNR3-function into a DNR2-function. 

1.3. Notations and Conventions. For any sets X and Y, we say that / is a function from XtoY (written 
/ : X — > F) if the domain dom(/) of / includes X, and the range range(/) of / is included in Y. We also 
use the notation / :C X — > 7 to denote that / is a partial function from X to Y, i.e., the domain dom(/) 
of / is included in X, and the range range(/) of / is also included in Y. 

For basic terminology in Computability Theory, see Soare [67]. For cr e M"^^, we let |o"| denote the 
length of cr. For cr e N*^^ and / e N^^ U N*^, we say that cr is an initial segment of / (denoted by 
cr c /) if o-(n) = f(n) for each n < \cr\. Moreover, fin denotes the unique initial segment of / of 
length n. let cr" denote an immediate predecessor node of cr, i.e. o-^ = cr \ (|cr| - 1). We also define 
[o"] = {/ £ • / ^ cr|- A tree is a subset of N"^'^ closed under taking initial segments. For any tree 
T c N^^, we also let [T] be the set of all infinite paths of T, i.e., / belongs to [T] if f [ n belongs to T 
for each n e M. A node cr e T is extendible if [T] n [cr] 0. Let T"^"' denote the set of all extendible 
nodes of T. We say that cr € T is a leaf or a dead end if there is no r £ T with r 2 cr. 

For any set X, the tree X"^^ of finite words on X forms a monoid under concatenation ~. Here the 
concatenation of o- and t is defined by (cr~T)(n) - cr{n) for n < |cr| and (cr~T)(|cr| + n) = T{n) for n < \t\. 
We use symbols ~ and fl for the operation on this monoid, where Y^i<nO-i denotes cro~cri~ . . . ~cr„. 
To avoid confusion, the symbols x and n are only used for a product of sets. We often consider the 
following three left monoid actions of X"*^^: The first one is the set X^ of infinite words on X with an 
operation ^ : x X^ ^ X^; {a' f){n) = a-{n) for n < \cr\ and (cr-/)(|cr| + n) ^ f{n) for n e N. The 
second one is the set T{X) of subtrees T c X<^ with an operation ~ : X<^ x 7~(X) T{X); cr^T = 
{cr'T : T e r). The third one is the power set 'P(XN) of X^ with an operation " : X^^ x P{X^) 'P(XN); 
cr-p = {cT~f -.feP). 

We say that a set P c is n° if there is a computable relation R such that P = {/ e : {Vn)R(n, /)) 
holds. Equivalently, P = [Tp] for some computable tree Tp c N^. Let (Oglggfj be an eff"ective enumer- 
ation of all partial computable functionals. Then the e-th H^ subset of 2^ is defined by Pe = {f € 2^ : 
^e{f',0) tl- Note that {Pe]een is an effective enumeration of all 11^ subsets of Cantor space 2^. If (an 
index e of) a H^ set Pg c 2*^ is given, then P^ = (cr e 2^^ : <l>e(cr; 0) t) is called the corresponding tree 
for Pe- Here <I>(cr; n) for cr e N*^^ and n eM denotes the computation of <1) with an oracle cr, an input n, 
and step |cr|. If P c 2^ is Hj, then the corresponding tree Tp c 2*^^*^ of P is computable, and [T] = P. 
Moreover, the set Lp of all leaves of the computable tree Tp is also computable. We also say that a 
sequence of {P,),e/ of H^ subsets of a space X is computable or uniform if the set {(/, f) e I x X : f e Pj] 
is again a 11° subset of the product space / x X. A set P c is special if P is nonempty and P has no 
computable member. For f,g e N^, / © g is defined by (/ © g)(2n) = f(n) and (/ © g)(2« -1- 1) = gin) for 
each nen. For P, 2 c N^, put P © 2 = «0)~P) U «l)-0 and P ® 2 = {/ ©^ : / £ P&g e Q]. 
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2. Motivation and Terminology 

2.1. Medvedev's Semantics for Intuitionism. To formulate a semantics for IPC, Kolmogorov tried 
to interpret each proposition as a problem. Medvedev [49] formalized his idea by interpreting each 
proposition as a mass problem ^pj c N'*. Under the interpretation: 

(1) A proof n is a dynamical process represented by an infinite sequence of natural numbers, i.e., 

(2) is the set of all proofs of a proposition p, i.e., c N*^. 

(3) A proposition p is provable if p has a computable proof, i.e., [[/j]] c N*^ contains a computable 
element. 

To prove the disjunction pq V pi, we need to algorithmically decide which part is valid, i.e., we first 
declare one part to be valid and then construct a witness for this part. Consequently, pqV pi is provable 
under that interpretation if and only if we can algorithmically construct an element of ^pQ V piJ = 
IPqI ® Ipil = {(')"/ : / < 2 & / e Ipii). Generally, let Form denote the all propositional formulas. 
Medvedev's idea is defining a mass-problem-interpretation of IPC by a function |[-| : Form — > 'P(N^) as 
in Definition 1 . 

Definition 1. We say that a function [[■]] : Form — > !P(N^) is a Medvedev interpretation if it satisfies the 
following six conditions. 

(1) l[T| contains a computable element. 

(2) = 0. 

(3) lifi A iffj ^ ^ {f ® g : f e m & g e m). 

(4) V - m ® m - my ■■ / e m) u nirg ■. g e m). 

(5) ^ lAi - m ^ m - {e'g I ® *) : m ^ m). 

(6) C-^l ^lip^±J. 

Here, <^{g®*) denotes the partial function /l/.0(g©/) :C N'* N^, and recall that is the e-th partial 
computable function on N'^. 

Definition 2 (Medvedev [49]). For sets P, g c N^, P is Medvedev reducible to Q (written P <\ Q) 
if a computable function ^ : Q ^ P exists. In other words, P <\ Q means the existence of a partial 
computable function O on Baire space N'^ with dom(O) 2 Q and rng(O) c P. If both P <\ Q and 
Q <\ P, then we say that P is Medvedev equivalent to Q (written P =} Q). 

If a lattice (L, <, V, A) has the top element 1, the bottom element 0, and max{c : c /\a <b] (denoted by 
a — >i b) exists for any a,b e L, then X = {L, <, V, A, -^l, 0, 1) is called a Heyting algebra. An algebra 
X = (Z., <, V, A, — >, J., T) is a Brouwer algebra if its dual = (L, >, A, V, «— , T, J.) is a Heyting algebra. 

Theorem 3 (Medvedev [49]). The quotient algebra D} called the Medvedev lattice is Brouwerian. Here, 
n\ - ('P(NN),<},®,©,-^,N^,0)/ =}. 

Following Medvedev [49], Muchnik [52] introduced another calculus of mass problems. His calculus 
is non-uniform, but preserves computability in the following sense. A function / :C — > is 
nonuniformly computable if /(x) <j x holds for any x e dom(/), where the symbol <t denotes the 
Turing reducibility. Let [£7-]} denote the class of all computable functions / :C N*^ — > N^, and let [£7]^ 
denote the class of all nonuniformly computable functions / :C N'^ — > N*^. Clearly, [(£7]} c [Ej-]^. 
Actually, we have #[£7]^ ^ 1'^^° while [(£7]} is countable. 

Definition 4 (Muchnik [52]). For sets P,Q Q N^, P is Muchnik reducible to Q (written P Q) if a 
nonuniformly computable function . Q ^ P exists. If both P Q and Q <^ P, then we say that P is 
Muchnik equivalent to Q (written P Q). 
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Theorem 5 (Muchnik [52]). The quotient algebra called the Muchnik lattice is Brouwerian. Here, 
iy( = ('P(N^),<^,®,e,^',N^,0)/ =^ with the (dual) implication P ^' Q = {g e \ (BY e 

[Crip ng®*)-p^Q]. 

Remark. 

(1) Usually, the Medvedev reducibility is written as <m or and the Muchnik reducibility is writ- 
ten by <w However, later we will introduce the notion of (Q',/J)-reducibility for Qf,yS € {1,< 
oj, a>}, and then the Medvedev reducibility and the Muchnik reducibility are treated as the (1, 1)- 
reducibility and the (oj, \)-reducibility , respectively. This is the reason why we use the notations 
<} and <^ for the Medvedev reducibility and the Muchnik reducibility, respectively. 

(2) Both of the Medvedev lattice 25} and the Muchnik lattice provide sound and complete se- 
mantics for Jankov's Logic KC = IPC + y ->->p, the intuitionistic propositional logic with 
the weak law of excluded middle, which is also called De Morgan logic. The Medvedev lat- 
tice and the Muchnik lattice are extensively studied from the aspect of Intermediate Logic. See 
Sorbi-Terwijn [69] and Hinman [37]. 

(3) Forty years after the pioneering work by Muchnik, the Muchnik reducibility become useful in the 
context of Reverse Mathematics (see Simpson [64]). The reason is that the Muchnik reducibility 

is strongly associated with the provability relation in RCA, the recursive comprehension 
axiom. Then, the Muchnik degrees of IIj subsets of 2^ might be seen as instances of WKL, 
the weak Konig's lemma. For example, by using a result of Binns and Simpson [8] for the 
Muchnik degrees of subsets of 2^, Mummert [53] obtains an embedding theorem about the 
Lindenbaum algebra between RCAq and WKLq. 

(4) For more basic results about the Medvedev and Muchnik degrees of 11° subsets of 2^*^, see Simp- 
son [61, 62, 63, 65]. There ai^e lots of research on the algebraic structure of the Medvedev 
degrees of subsets of 2^, such as density [20], embeddability of distributive lattices [8], 
join-reducibility [7], meet-irreducibility [2], noncuppability [19], decidability [24], and unde- 
cidability [60]. As a computable-analysistic approach of (Constructive) Reverse Mathematics, 
the Weihrauch degrees which is a common extension of the Medvedev degrees and the Wadge 
degrees is also studied [11, 13, 12]. 

2.2. Disjunction Operations Based on Learning Theory. Hayashi [35, 36] introduced Limit Com- 
putable Mathematics (LCM), an extended constructive mathematics based on Learning Theory. Like 
the BHK-interpretation for intuitionistic logic, there is a limit-BHK interpratation for Limit Computable 
Mathematics. We introduce three mass-problem-interpretations |[-]jLQ|y : Form — > 'P(N^) of LCM based 
on the limit-BHK interpretation. To formulate a mass-problem-style interpretation of LCM, imagine the 
following dynamic proof models. 

The one-tape model is defined as follows: When a verifier ^ tries to prove that "Pq or Pi", a tape A is 
given. At each stage, Y declares or 1 , and writes one letter on the tape A. 

• Intuitionism: ^ does not change his declaration, say / e jO, 1}, and the infinite word written on 
the tape A witnesses the validity of P,-. 

• LCM: the sequence of declarations of ^ converges, say / 6 {0, 1), and the infinite word written 
on the tape A witnesses the validity of P,-. 

• Classical: any declaration of ^ is nonsense, and the infinite word written on the tape A witnesses 
the validity of Pq or Pi. 

The two-tape model is follows: When a verifier 4' tries to prove "Pq or Pi", two tapes Aq and Ai are 
given. At each stage, ^ declares or 1, say /, and he writes one letter on the tape A,. 

• Intuitionism: For either / < 2, the word written on Ai_,- is empty, and the infinite word written 
on A, witnesses the validity of P, . 
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• LCM: For either i < 2, the word written on Ai_, is finite, and the infinite word written on A, 
witnesses the validity of P,-. 

• Classical: For either / < 2, the infinite word written on A; witnesses the validity of P,-. 

The backtrack-tape model is follows: When a verifier *F tries to prove that "Pq or Pi", a paper □, and 
two infinite tapes A, A are given. The paper □ is called the declaration, A is called the working tape, and 
A is called the record tape. At each stage, the verifier works as follows. 

(1) If no letter is written on the declaration □, then ^ declares or 1 and this is written on the 
declaration □ and the record tape A. 

(2) When some letter is written on the declaration □, the verifier ^ chooses one letter k from N U {ft}, 
and his choice k is written on the record tape A. 

(a) In the case k %it expresses that Y writes the letter k on the working tape A. 

(b) In the case ^ = ft, it expresses that *F erases all letters from the declaration □ and the working 
tape A. 

• Intuitionism: ^ does not choose (}, hence he does not change his declaration, say /, and the 
infinite word written on the tape A witnesses the validity of P,-. 

• LCM: ^ chooses jj at most finitely often, hence the sequence of declarations of ^ converges, say 
/, and the infinite word written on the tape A witnesses the validity of P,-. 

• Classical: No classical counterpart. 

To give formal definitions of these dynamic proof models, we introduce some auxiliary definitions. 
Definition 6. 

(1) For X = {xq,xi) e / X N, the first (second, resp.) coordinate xq (xi, resp.) is denoted by (x)o 
{ix)i, resp.). Fix a e (I x N)*^^, and / € /. Then the i-th projection of cr is inductively defined as 
follows. 

pr;(o-~)~?i, if cr - cr {{i,n)). 



pr,«)) = 0, pr,.(cT) = 



|pr,(o" ), otherwise. 



Moreover, the mind-change of a is given by inc(o") = #[n < |a"| - 1 : (o"(n))o (cr(?i + l))o}. 
Furthermore, for f e {I x N)^, we define pr;(/) - lJ«eN P^iif \ for each / e /, and mc(/) = 
lim„ mc(/ r n). 

(2) For any set X and string cr e X'^^, the n-th shift cr'~" is defined as cr'~"{m) = cr{n + m) for 
each m < \o-\ - n. The tail of cr is defined as tail(cr) - a^"\ for the least m e N such that 
cr{k) + (t for all k > m. Furthermore, for / e X^, we define - Um>«(/ \ m)"", and 
tail(/) = lim,„ tail(/ |~ m) if the limit exists. 

Example 7. We consider two functions cr e (2 x N)'^'^ and r e (N U 

(1) If cr = ((1,3), (1, 1), (0, 4), (0, 15), (1, 9), (0, 26), (0, 5)>, then the projections of cr are pro(cr) = 
(4, 15,26,5), and pri(cr) = (3, 1,9). Moreover, mc(cr) = 3. 

(2) IfT = (0,2, 7, 18,28, j, 1,8, 2, 8, 45, 9,^,0, 4, 52, 35, 3, 6), then the tail of r is tail(T) = t^i^ ^ 
(0,4, 52,35,3,6). 

Definition 8 (One-Tape Disjunctions). Let Pq and Pi be subsets of Baire space N^. 



(1) IPo^ Filial = [Ji<2i{i''}^ Pi)- 

(2) IPo V Piji^^ = U;<2({/ e : (V'"^) fin) = i} ® P,). 
1 

CL 



(3) IPoVPili,, = U-<2(2^®^/)- 



Here, / denotes the infinite sequence consisting of /'s, i.e., / = (i, i, /, /, /, . . .). 

Definition 9 (Two-Tape Disjunctions). Let Pq and Pi be subsets of Baire space N^. 

(1) IPo V Pilf, , - {/ e (2 X N)N : ((3/ < 2) pr,(/) £ Pi) & mc(/) = 0). 

(2) IPo V Pi|2^^ - {/ e (2 X N)N : ((B/ < 2) prK/) e P;) & mc(/) < oo}. 
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(3) IPo V - {/ e (2 X N)N : (3/ < 2) pr,(/) € Pi). 

Definition 10 (Backtrack Disjunctions). Let Pq and Pi be subsets of Baire space N^. 

(1) IPo V Pil^,, - {/ e (N U mf ■■ tail(/)^' e ^taii(/;0) & (Vn) f{n) + %\. 

(2) IPo V Pil^LCM - 1/ e (N U : tail(/)^i € Ptaii(/;0) & (V-n) /(«) + % 

Remark. Note that we always have to choose a new symbol ft which has not been already used. We 
consider the set S , of all symbols which has been already used, where 5 o = N. Then, each symbol 5' e 5 , 
always codes (0, s), and the new symbol (j codes (1,0). The symbol fj is enumerated into 5;+i, when we 
define some set X c (5 U . Here the symbol S U {ft) means that ({0} x 5) U {(1,0)}. Usually, both of 
S, and 5,+! = 5, U {(() are coded as subsets of N, by using a fixed bijection between N and 2 x N. 

Proposition 11. Let P and Q be subsets of Baire space N^. 

(1) IP V PI^ =1 Pfor each X e {Int, LCM, CL). 

(2) IP V ei^L V ei'LCM <| V eiint/o^ each / £ 1 1, 2, 3). 

(3) IP V 2]]^ <} IP V ei^/or eac/i ; < / and X e {Int, LCM, CL). 

(4) P©e=I IP V!2]j;„,/oreac/i/e {1,2,3). 

(5) PUQ^I IPvei^L- 

Proof. (1) The reduction / ® g i-^ g witnesses P <} IP V PJ^, and the reduction / i-> write(0, /) 
witnesses IP V PJ^ <} P, for each X e {Int, LCM, CL). Here, write(0,/) represents write(0,/) = 
0^ ® / = <(0, /(O)), (0, /(I)), (0, /(2)), . . . , (0, f{n)), (0, /(« + !)),...) which indicates the instruction, in 
the one-tape model, to declare "Pq is con^ect" at each stage and to write the infinite word / on the tape 
A. 

(2) Clearly, IP V Qj{.^ 2 IP V QU'lcm 2 V QJ\^^ for each / e {1, 2, 3). 

(3) Fix X € {Int, LCM, CL). We inductively construct a computable function H witnessing IP V 
21^ <} IP V QJx- First set H(()) = (), and assume that E{a ® /?) has been already defined for ev- 
ery strings a and /? of length s. Then we now define H(cr © r) for each strings cr and r of length 
5-1-1. For p = |pro-(^.)(H(cr^ © t"))| (recall that cr" denotes the immediate predecessor of o"), we put 
H(o" © t) = H(o"~ © T~)~write(o"(5'), t'"-''). Here, write(/, a) for / e / and a e N"*-^ is defined as 
/H ® a = ((/, a(0)), (/, a(l )),...,(/, ado-l - 1))), i.e., write(/, o-) indicates the instruction to write the 
finite word a on the i-th tape A, in the two-tape model. Then, we can inductively ensure the following 
condition. 

pr^(,)(H(cr © r)) = pr,^(,)(H(o-- © T-)y{T^P) = t. 

Finally, we set E{f ® g) = UneN^CC/ I n) ® {g [ «)), for any f,g e N^. Therefore, for any 
/ © ^ e IP V and each / < 2, if f{n) = i for infinitely many n e N, then pr,(E(/ © g)) is total, and 
pr,(H(/ © g)) - g. By definition, pr,(H(/ ® g)) = g e P,- for some / < 2. Hence, H(/ © ^) e IP V 

Fix X £ {Int, LCM). We inductively construct a computable function H witnessing IP V <} 
IP V First set H«(/, «))) = </, n) for each (/, «) e 2 x N. Fix cr ^ a-— <(/, ni), (7, «)) e (2 x N)^^, 
and assume that H(cr") has been already defined. Then, let us define H(cr) as follows: 

{H(o"")~(n) if j - i; 

H(o" )~(p,7) pi'y(cr) otherwise. 

Finally set H(/) = |J„ E{f f n), for any / e (2 x N)^. It is easy to see that tail(/) is defined for any 
felPv since #{ken: E{f;k) = ^] = mc(/). Therefore, tail^i(S(/)) e Ptaii(S(/);0)- If ^ = Int, 
then no ft occurs in H(/). 

(4) By definition, IP V QJ^^^ = P ® Q. (5) The reduction f®g^g witnesses P U Q <} IP V Ql\.^, 
and the reduction / 1-^ write(0, /) = 0*^ © / witnesses IP V <} P U □ 
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Definition 12. For each proof model, there are variations of LCM disjunctions, for any bound of mind 
changes. Let Pq, Pi be any subset of Baire space N^, and n be any natural number. 

(1) The one-tape LCM disjunction oJPq and P\ with mind-changes-bound n is defined as follows. 

IPo V Pxt.cmn} = ^ 'Pi^LCM ^ {/ € 2^ : #{„ 6 N : f{n +\)+ f{n)\ < n] ® 2^. 

(2) The two-tape LCM disjunction ofPo and P\ with mind-changes-bound n is defined as follows. 

IPo V Pi]Ilcm[«] ^ V Pil^cM n {/ € (2 X Nf : mc(/) < n}. 

(3) The backtrack-tape LCM disjunction of Pq and Pi with mind-changes-bound n is defined as 
follows. 

IPo V PiI'lcmw = 1^0 V PiJlc^ n {/ e (N U mf : #{/: e N : f{k) = ^} < n). 
Proposition 13. Let P Q be subsets of Baire space N^. 

(1) P © G =} IP V Q\cMU] ^'^'^^ ^ (2, 3). 

(2) IP V PH^c^pj ^} [P V PJl^^^^^. Indeed, l[V,<„ ^/I'lcmw ^ PJ^^^^^^j, w/iere P,- = Pfor 
each i < n. Here, for each collection {Pi}i<k of subsets of Baire space, |[Vi<yt ']Ilcm[«] ''^ defined 
as follows. 

{fe{kx nf : ((3/ < k) prK/) e P,) & mc(/) < n). 

Proof (1) Clearly |[P V 2]Ilcm[1] ^ ^ Qlj^, for each / e {1,2,3}. By Proposition 11 (4), we have 
P©(2^| |[Pve4,. 

(2) The reduction 5 : /j i-> /i* in the proof of Proposition 11 (3) also witnesses |[P V ^]Ilcm[h] -i 
I[V/<«^rlLCM[n]- inductivcly define a computable function H* witnessing l[V(<» ^/]Ilcm[«] -1 1^ 
^]Ilcm[«]- = ^"'^ fix cr - o-^-(A:) e (N U (HD^*^. Assume that 5*(o-) has been akeady 

defined. Then, E*(cr) is defined as follows. 

count(o") = #{m < |o"| : o-{m) - jl), 

/s*(cr-r((count(cr),^)> iffc^ft, 
^ (o" (a:)) = < 

S*(cr ) otherwise. 



For any g € |[P V ^Ulcmm' ^^'^^ count(g I s) < n for any 5 e N, and hence mc(E*(g)) < n, since g 

lim, count(g|'.v)( 



contains at most n many fj's. Moreover, prij,-r, county r.v)('^*(5)) = t^ilfe)^' ^ ^- 



Proposition 14. Let Pq, Pi, 2o. ^^nii Qi be subsets of Baire space N^, and fix i € {2,3} and X € 
{lnt,LCM,CL}U{LCM[n] : « e N}. //Pq <[ Q^andPi <{ Qi, EPq vPiI^ <{ IGo Vgil^. //ence, 
the operator D'^ : 2)}x£)} ^ D} introduced by D'^{A&g\{P),A&g\{Q)) = &eg\{lPy Qf£) is well-defined. 
Here, degj(P) denotes the equivalent class [R c : P =[ P}. 

Proof. We first consider the two-tape model. Assume that Pq <} Qq and Pi <} Q\ via computable 
functions Fq and Fi , respectively. We construct a computable function A witnessing |[Po vPi <} |[2o V 
Qij\. Set A(()). Fix o" £ (2 x N)<^ and assume that A(cr ) has been already defined. For each / < 2, we 
define e N"^*^ as follows. If F,(pr,(cr)) 2 F,(pr,(o"")), say F,(pr,(cr)) = Fj(prj(cr"))~?7, then we set 77,- = 
write(/, 77) for such a string 77, where recall write(/, 77) - /'''' © 77 = ((/, 77(0)), (/, 77(1)), . . . , (/, 77(177! - 1))). 
If F,(pr,(cr)) - F;(pr,(a"")), then we set 77; = (). Then we define A(o-) = A(cr~)~77o~77i. Note that 770 - {) 
or 771 = (), since pr,(cr) = pr,(cr~) for either / < 2. Therefore, mc(A(g)) - mc(g) for any g e N^. 
Furthermore, for any g £ N'^, we have pr,(A(g)) = F,(pr,(g)) for each / < 2. Thus, A(g) e |[Po V Pil| 

foranyg£|[eoveil|- 

Next we consider the backtrack-tape model. Assume that Pq <} Qq and Pi <} Q\ via computable 
functions Fq and Fi, respectively. We construct a computable function witnessing |[Po V Pil^ <} 
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IGo V QiT^. Set 0(0). Fix cr e (2 x N)<'^ and assume that 0(t) has been already defined for each t Q cr. 
If o" = cr ~{m,n} for some m,n e N, then we have rtaii(o-;0)(tail(cr)"'^) = rtaii(o-;0)(tail(cr)'~^)~;7 
for some ij e N"^*^, and we define 0(cr) = @{o-^)~t]. If cr = cr (jj, /) for some / < 2, i.e., tail(o"; 0) = i, 
then define 0(cr) = 0(cr")~(f(, /). Otherwise, we set 0(cr) = 0(cr~). Note that#{?i e N : &ig;n) = ^} = 
#{n eN : g{n) = }j} for any g e N^. Furthermore, tail(0(g);O) = tail(g;0), and tail(0(g))^' = 
rtaiite;0)(tail(g)^i) for any gelQoV Hence, 0(g) e |[Po V Pi]|| for any gelQoV Qif^. □ 

Remark. The one-tape disjunctions are hard to analyze and are useless in our study, because they are 
badly behaved in the sense of Proposition 14. Indeed, by analyzing the proofs of Proposition 53 and 
Corollary 54, it is easy to see that there is a 11° subset P of Cantor space such that EP VP]^ ^} |[PvP*|^ 
for each X e {LCM, CL), where P* = {g ® f : f ® g e P]. Though the original hmit-BHK interpretation 
of the disjunctive notion seems to be a one-tape notion, we will observe that the two-tape notions and 
the backtrack notions exhibit amazing and fascinating behaviors as operations on the subsets of Baire 
space. While the one-tape models are almost statistic, the two-tape models can be understood as learning 
proof models with bounded-errors, and the backtrack tape models can be understood as learning proof 
models with no predetermined bound for errors. In section 3, we adopt the two-tape notions expect for 
the classical one-tape disjunction U, since the two-tape notions (the bounded-errors learning models) 
is useful to clarify differences among the classes [(£7]}, [(£7-]^^, [^t]^^^, [^t]^"^ which are defined (as 
certain classes of bounded-errors functions) later. In section 4, we adopt dynamic generalizations of the 
backtrack tape models since such models turn out to be a strong tool to establish many theorems. 

We now note that the stiaightforward two-tape (backtrack) notion is hard to use, since, for instance, 
fP V 21lcm[2] belong to 11° even if P and Q are Hy This observation prompts us to define 

consistent two-tape disjunctions. The consistency set Con{Ti)i^i for {r, );g/ is defined as follows. 

Con(rO,-e/ - {/ e (/ X N)N : (V/ e /)(Vn e N) pr,.(/ I n) e P;). 

Then we use the following modified definitions. 

Definition 15. Let Pq and Pi denote n° subsets of N^. 

/'oV^Pi = EPo V PiJl^^ n Con(Pp„, Pp,). 

PoV„Pi = EPo V PiUlcmw ^ Con(rp„, Pp,). 

PoVooPi = EPo V PiJl^ n Con(Pp„, Pp,). 

Here Tp^ and Pp, are corresponding trees for Pq and Pi, respectively. 

Proposition 16. Let P and Q be 11° subsets o/N^. 

(1) P^nQ ^\ IP V Qf^^^^^^^ for each neM. 

(2) Pv^e IP V QJl^^. 

(3) pveoG ^1 IP V ei^L- 

Proof. For each item, clearly Pv^Q >{ E^ V 23* ■ Thus, it suffices to construct a computable functional 
O witnessing Pv^Q <} E^ V 21*- Let Pq and Pi denote the coiTcsponding computable ti'ees for P and 
Q respectively. Set 0(()) - {). Fix cr e (2 x N)"**^. Assume that <l>(cr") has already been defined, and 
cr = cr ((/, k)) for some / < 2 and ^ £ N. If pr,(cr) £ P,-, then we set <l)(cr) - (^{cr~)~{{i, k)). Otherwise, 
we set 0(cr) = 0(cr"). Clearly, <1) is a computable function, since P, is computable for each / < 2. For 
any g e {2x nf, clearly mc((D(g)) < mc(g). Fix g e IP V QJI, where * e {LCM, LCM[n], CL). Then 
priig) e Pi for some / < 2, where Pq = P and Pi = Q. Therefore, 0(g) is total, and pr,(0(g)) e P,- for 
such i <2. □ 

Proposition 17. Let P and Q be 11° subsets ofN^. 
(1) PVnQ is n° for any n € N. 
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(2) Pv^e is xo 

(3) PVeoG is n?. 

Proof. Let Tq and Ti denote the corresponding computable trees for P and Q respectively. We consider 
the following computable tree: 

Tp.Q,n - {cr e (2 X N)<^ : (V/ < 2) pr;(cr) e T,- & mc(o-) < n]. 

Note that Tpg,, is uniformly computable in n, since pr,(cr) and mc(cr) are computable uniformly in 
cr e N^^. Clearly, Pv„Q c [rp,Q_„]. Moreover, for any g e [Tp^Q^„], pr;(g) is total for some / < 2. Then, 
pr,(g) € [r,] for such /, and mc{g) < n, since the relation mc(/) < n is equivalent to (Vk) mc(/ I k) < n. 
Thus, g e Pv„2. Consequently, Pv„2 = [Pp.g,,,] is n°. Hence, Pv^Q ^ U«[rp,e,«] is S°. The items (3) 
also follows from the similar argument. □ 

Definition 18. Pick any * e N U [oj] U {oo}. For each disjunctive notions V* and sets Po,Pi c N^, fix 
any trees Tp. c N"^^ for / < 2, and c N"^^ such that [Tp.] is the closure of P,- for each / < 2, and 
[r,] is also the closure of PoV,Pi, under the Baire topology. Then the heart of Pq^^P^ is defined by 
= {(T e n : (V/ < 2) pr,((r) 6 P^'). 

Proposition 19. P,^ c Pf^'. 

Proo/ P,^ c {o- € P, : (3/ < 2) pr,(cr) e P^f } = Pf ^ □ 

This notion is not quite useful when either Pq or Pi is not closed. The heart plays an important role 
only when Pq and Pi ai^e n° subsets of 2^, with the corresponding computable tree P* c 4^^. 

2.3. Concatenations versus Disjunction Operations. 

Definition 20. Let Lp denote the set of all leaves of the corresponding tree for a closed set P. Then the 
(non-commutative) concatenation ofP and Q is defined as follows. 

P'Q = Pu [Jp-Q. 

peLp 

The commutative concatenation of P and Q is defined by PvQ = (P^Q) ® (Q~P)- 

Remark. On the study of Wadge degrees of finite level of Borel hierarchy, Duparc [30] introduced 
various operators such as P *2 = P U UpeN^i'P ^tD'G- The following proposition indicates that our 
non-commutative concatenation is essentially same as Duparc's operation P ^Q. 

Proposition 21. Let P,Q be IIj subsets of Baire space N^. Then, the concatenation P~Q is (1, 1)- 

equivalent to the set P^Q of all infinite paths of the tree {cr"(ft)"T : (T e Tp & t e Tq). 

Proof. To see P^Q <} P~Q, we inductively define a total computable function cut : N*^ N^. First 
set cut(()) = {), and fix o" = a (n) e N^^. We assume that cut(cr") has been already defined. If 
o" = cr {n) € Lp, then we set cut(o") = cut(cr^)~(n, (j). Otherwise, we set cut(o") = cut{cr~)~{n}. 
Then, cut is computable, since P is IIj and then Tp is computable. Moreover, we can see the following. 



cut(/) 




if/eP 

if{3keM) f t ke Lp. 

Clearly, P~^Q <} P''Q via the computable function cut. 

Conversely, we consider the computable function leaf : N^^ N*^^ which maps cr to the least leaf 
of Lp extending cr. Then, we inductively define a computable function F witnessing P~Q <\ P^Q as 
follows. First set F(()) = (>, and fix cr = cr {n) e (N U Ittl)"^^. We assume that F(cr^) has been already 
defined. If n ft, then we set F(o") = F(o"")"(«). If n = (j, then we set F(cr) = leaf(F(a"~)). It is easy to 
see that P'Q <\ P^Q via F. □ 
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Remark. (1) A variation of the non-commutative concatenation was used by Binns-Simpson [8] to 
embed the free Boolean algebra into the Muchnik lattice of n° subsets of Cantor space, and such 
a variation was called a recursive meet. The concatenation can be extended to the following in- 
finitaiy concatenation: P~{Qi}ieH = P^UnPn'Qn, where p„ is the «-th leaf of the corresponding 
computable tree of P. Then the recursive meet of {Qi}iei;i is defined by Qi - CPA~{2,},gN, 

where CPA is the set of all complete consistent extensions of Peano Arithmetic. Note that CPA 
is a Medvedev complete IIj subset of 2^. That is to say, for any nonempty 11^ subset P c 2^, 
a computable function <1) : CPA ^ P exists. The significance of the recursive meet Qi is 
that it is a ITj subset of the compact space 2^*^, while ^ . Qi is a subset of N^, and, indeed, is 
not compact. Actually, Simpson [61] used the recursive meet to construct an embedding of the 
Muchnik degrees of subsets of 2^ into the Muchnik degrees of n*' subsets of 2^. 
(2) More explicitly, the non-commutative concatenation has been used by Cenzer-Kihara-Weber- 
Wu [19]. A set P c 2^ is tree-immune if the tree {cr € 2^^^ : P n [cr] + 0) includes 
no infinite computable subtree. Cenzer-Kihara- Weber- Wu [19] showed that CPA" CPA has a 
greatest Medvedev degree of 11° subsets of 2^ with no tree-immune. 

Proposition 22. Let P, Q be n'^' subsets o/N^. 
(1) PvP =\ P P. 



(2) Pve-l IPyQtcmiv 

Proof. (1) PvP = (P-P) © (P-P) =j P-P. (2) By Proposition 16 (1), we have PV2Q =} IP V Qll 
Then, PV2Q <[ P^Q is witnessed by the following reduction A. 



Here, Tq and T\ are the corresponding computable trees for P and Q respectively, and L, is the set of 
all leaves of P,- for each / < 2. Clearly, A is computable. Fix {i)" g e PvQ. Obviously, mc((/)~^) < 2. 
If g e [P,] then pr,(A((/)~^)) = g € [P,], and if g - cr~h for some cr € L,- and h e [Pi-,] then 
pr,.(A«/)-(r-/i)) = he [Pj.,]. Hence, A«/)-g) e PWjQ. 

To see PvQ <} P^iQ, it suffices to construct a computable functional T witnessing {P^Q)®{Q~^P) <\ 
P^iQ by Proposition 21. Set r(()) = (), and r«(/,«))) = </» for any / < 2 and n e N. Fix cr = 
cr ~{(i,m),{j,n)} e (2 X N)^^, and assume that T{cr^) is akeady defined. If / j, then set r(cr) = 
p~((}, «). Otherwise, set r(cr) = T{cr^)~{n}. Clearly F is computable. Fix g e PV2Q. If nic(g) = 0, then 
r{g) = </>~pr,(g) e P®2 c (P^2)©(2^P), where / = (g{0))o. If mc{g) = 1, then pr,(g) is a finite string, 
where / = (g(0))o. In this case, we can easily see T{g) = (i)~pr,(g)"(|l)~pri_,(g) e (P^Q) © (Q^P)- □ 

In the case of PvP, we use the non-commutative concatenation P~P to simplify our proof without 
mentioning. 

Remark. The commutative concatenation can be viewed as a kind of consistent conservative Popperian 
learning (see [38]). 

• The term "consistent" means: the scientist should modify his hypothesis whenever it was found 
to be refuted. 

• The term ''conservative" means: the scientist changes his hypothesis only when it was found to 



• The term "Popperian" means: the scientist can test whether his hypothesis is currently consistent 



The notion of Popperian learning is introduced by Case and Ngo-Manguelle [17] based on Gold's theory 
of "identification in the limit" [33]. A learner (a scientist) is a computable function *P : N*^^ — > N, and 
a natural phenomenon is a computable function / : N ^ N. Then the formula ^'{f I n) = e means the 




if/^i e[r^(0)], 
), if(3^eN)/^' eL^(o). 



be refuted. 



or refuted. 



inside the muchnik degrees: 

Table 1. 
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P ® Q Intuitionistic disujunction (= P^\Q) 
Pu Q Classical one-tape disjunction 

PvQ Commutative concatenation {= PV2Q) 

P^nQ LCM disjunction with mind-changes-bound n 
P^cjQ LCM disjunction 

f Voo2 Classical disjunction 



following situation: the scientist Y predicts that a rule generating the phenomenon / can be explained 
by a word (a formula, or an algorithm) e (i.e., / = Og) when he observes /(O), . . ./(« - 1). We say 
that ^ learns f if ^iim„^{f[n) = /■ The learner ^ is Popperian if ^^'(a-) is total for each cr e M^'^. 
The learner ^ is consistent at o" e N^^ if <l>>p(o-) t |o"| = cr. The learner ^ is conservative if, for any 
o" € N*^^, ^(cr) = *F((t") whenever O^na-) I = cr. Note that, for every Popperian learner *F, he can 
algorithmically determine whether *P is consistent at cr or not, for a given cr e N^^. The terminology 
"Popperian" derives from Popper's refutability principle in philosophy of science. In this context, the 
non-commutative concatenation P~Q of P and Q represents the following situation: if, and only if, a 
choice on the first hypothesis P is refuted, then the scientist proposes the second (refutable) hypothesis 
Q and start verifying it. The reason why P~ Q is Popperian will be discussed later. 

Proposition 23. For n° sets 2 c and neM, 

V efLCM < IP V G]|'lCM[.+2] ^! IP V QtcL 4 IP V Qllv 

Proof. It suffices to show PwQ <\ P U Q, since IP V QJ^.^ =\ P U Q by Proposition 11 (5) and 
IP V G]1lcm[2] ^1 P^Q Proposition 22 (2). Indeed, we can show that (P'^Q) ® (Q'P) <{ P U Q. 
We construct a computable functional O witnessing P~Q <} P U Q. If cr e Tp, then set <l>(cr) = cr. If 
cr ^ Tp, then pick a unique p Q cr such that p e Lp, and set <l)(o") = p~cr for such p, where Lp is the set 
of all leaves of Tp. Cleai^ly $ is computable, and note that <l>(o") c 0(t) whenever cr c r. If g e P, then 
^te) - 8 ^ P-^^ g ^ Q\P^ then there is a unique peg such that p e Lp, and 0(g) = p"g £ /'^G- Thus, 
P~e<{ PUgviaO. □ 

Remark. These LCM-disjunction operations V2 (the concatenation operation) and v^^ are related to the 
sequential disjunction [40] and the toggling disjunction [41] in ComputabiUty Logic [39], respectively. 

Remark. In Theorem 161 (1), we will see that the non-commutative concatenation P~Q can be viewed 
as the iP^-law-of-excluded-middle operation. Here the arithmetical hierarchy for the law of excluded 
middle is studied by Akama-Berardi-Hayashi-Kohlenbach [1]. 

2.4. Nonuniformly Computable Discontinuous Functions. 

Proposition 24. For every partial computable function ^ :C N"^^ — > N, we can effectively find a total 
computable function *P : N^*^ — > N such that, if lim^ *P(/ [ s) converges, then lim^ Y(/ [ s) converges 

tolim,^(/ r^). 

Proof. Without loss of generality, we can assume Y(()) = 0. For given cr e N^^, put cr* = max{T c cr : 
^PWIJo-l] i). Then define ?(cr) - 'F(cr*) for every cr e N-"^. If hm, ^(/ \ s) converges then clearly 
lim^ ^(/ I s) also converges. □ 

For the e-th partial computable function :C N'^'^ — > N, is denoted by The set {*Fe}ggN is 
referred as the effective enumeration of all learners, and is called the e-th learner. 
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Table 2. Seven Classes of Nonuniformly Computable Functions 



(Uniformly) computable 
Learnable with bounded mind changes 
Learnable with bounded errors 
Learnable 
k-wise computable 
Learnable by a team 
Nonuniformly computable 



Remark. We urge the reader not to confuse the notions ^{cr) and <I>(o") for a leaner ^ and a computable 
function (on N^). In the former case, *F((t) simply denotes the output (the inference) of the learner 4^ 
based on the current input cr. In the latter case, however, we use cr as an initial segment of some oracle 
information, and so really 0(o") denotes a string (0(cr; 0), <l>(cr; 1), 0(o"; 2), . . .). 

We now introduce various subclasses of nonuniformly computable functions on N'^ based on Learning 
Theory. For an ordinal a, if or is a successor ordinal /3 + 1, then denotes yS, and if cy is a limit ordinal, 
then a' denotes the symbol < a. 

Definition 25. Let D be a subset of Baire space N^, and a,/i,y < w + 1 be ordinals. A function 
T : D is {a~ ,/i^\y^)-computable if there sue a < a, b < /i, c < y and / c N of cai^dinality a such 

that, for any g € D, there is e e I satisfying the following three conditions. 

(1) (Learnability) hm„ *P^(g [ n) converges, and ^\ira„^^(g\n){g) = ^{g)- 

(2) (Mind-Change Condition) #{n e N : T^(g \n + l)i^ T^(g \ n)\ < b. 

(3) (Error Condition) #{^e(g \ n) -.neM} <c. 

\fy - 0), then we simply say that F is {a,fi)-computable for (Q',yS|7)-computable function F. Let [Gr]^ 
(resp. [Gr]^!^) denote the set of all (Q',yS)-computable (resp. (Q',yS|7)-computable) functions. 

Remark. Some of (Q',yS|y)-computability notions are related to learnability notions: Every (1,< co)- 
computable function is learnable with bounded mind-changes; every {\,a)\ < tL>)-computable function is 
learnable with bounded errors; every (1, (x»)-computable function is learnable; every (< oj, l)-computable 
function is k-wise computable; and every (< u, a»)-computable function is team-leamable. The concept 
of learnability in the context of real number computation has been studied by some researchers includ- 
ing Chadzelek-Hotz [23], Ziegler [79, 78], and de Brecht-Yamamoto [26, 27]. The notion of ^-wise 
computability has been also studied by, for example, Ziegler [81]. 

Proposition 26. Let Y be a partial function on Baire space N*^. 

(1) IfY is {aQ,/i'^\y~)-computable, < a\, ySo < jSi, andyo < y\, then F is {ay,/3^\y^)-computable. 

(2) F is (a, \)-computable if and only ifY is {a,/i\l)-computable. 

(3) F is (a, fi)-computable if and only ifY is {a,/3\/3)-computable. 

(4) F is (1, V)-computable if and only ifY is computable. 

(5) F is {oj, \)-computable if and only ifY is (a», aj)-computable if and only ifY is nonuniformly com- 
putable, i.e., Y(g) <j gfor any g £ dom(F), where recall that <j denotes the Turing reducibility. 

Proof. The items (1) and (2) easily follow from definition. The item (3) follows from #{*Fe(g \ n) : n e 
N} - 1 < #{n : "Veig \n + l) + "Veig \ n)}. 

(4) If F is computable via O^, then F is (1, l)-computable via the singleton {i{e)\, where F,(g)(cr) - e 
for any cr e N^^. Assume that F is (1, l)-computable via a singleton {e\. Then *Fe(cr) = *Fe(()) for any cr 
extendible to an element of dom(F), since #{« e N : "Veig \ n + Y) ^e{g \ n)} = for any g 6 dom(F). 
Therefore, F is computable via ^^wm))- 



[er]l 
[Gr]r 
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(5) If r is nonuniformly computable, then T is (o), l)-computable via {i(e)}eetKh where r,(g)(o") - e for 
any cr £ N"^*^. Assume that F is {oj, (x>)-computable via /. For any g e dom(F), there is e e / such that 
lim„ r «) converges to some value p e N, and Op(g) = F(g). Thus, F(^) <j g via Op. □ 

Proposition 27. For eac/z m, n e N, every (wi, a)\n)-computable function is {m ■ n, \)-computable. 

Proof. Assume that F : D — > is {m, 6ij|n)-computable with m-learners {^''\e<m with «-errors. Now, we 
define an algorithm for any e <m and k < n, and we ensure the following property: 

(Vg e D){3e < m){k < n) ^g) = F(g). 

The algorithm proceeds as follows for g. Let B^g) be the set of all indices occurring in hypothesis of 
the learner by stage s, i.e., Bf,(g) ^ |e e N : (3m < s) e = ^(^ \ m)}. Put = ^ A:], and 

let dlig) be the unique element of B'j^.^^^ig) \ where B<i^(g) = 0. Cleai'ly, :C ^ N is 

partially computable. Then, we set 0^(g) = (g)(g). For any g e D, there is e < m such that lim, ^"(g \ 
s) converges to some con^ect computation d of F(g), i.e., Oj(g) = F(g). Since #{*F'^(g [~ 5) : s e N) < «, 
we have d^ig) = d for some k < n. Thus, for any g e D, there are e < m and ^ < n such that ^l(g) = F(g). 
Therefore, if is an index of for each e < m and k < n, then F is (m • l)-computable via an upper 
bound max |{/^ : e < m & k < n}\. □ 

Corollary 28. F (< w, a>| < oj)-computable if and only ifT is (< a>, \)-computable. 

Proof. Every (< oj, a»| < 6L))-computable function F is (m, tL»|?i)-computable for some m, n < oj. Therefore, 
by Proposition 27, F is (m • n, l)-computable. In particular, F is (< a», l)-computable, since m-n < on. □ 

Proposition 29. For each i < 2, let F,- be a partial {ai,Pj\yi)-computable function on Baire space N^, 
where ai,l5j,yj < co are ordinals. Then Fi o Fq is (cq * 0:1, /3o * ySilyo * y\)-computable, where * is the 
multiplication as the cardinals, or equivalently, k* A = min{/c • A, co]for ordinals k,A < o). 

Proof. For each / < 2, since F,- is (ai, Pi\yi)-computahle, there is a collection of learners, {^y)y<a, and a 
finite cover {t/j}y<,,, of dom(F;) such that F,(/) = <I'iim„r (/r«)(/ f ") #{« e N : ^^(/ [ n + I) 
^'jif I n)] < Pi and #{^'j(f [ n) : n € N] < yi, for any j < ai and / e W.. Fix j < and k < ai. 
Then *P*.^(o") is defined as follows. Let E{o-) be the set of all strings p Q cr satisfying H'^!(p) - ^^.{cr). 
Let p(cr) be the shortest string of E{cr), and set E*{cr) \ {p(o-)}. If #{t e £'*(o-) : "^[{t) + ^i(r-)) < /3i 
and #{H'1(t) : r e E{(t)\ < n, then put 4'*.^(o-) - »pi(a)^0(^)(o-)). Otherwise, put T*.^(o-) = Y*.^(cr-). For 
given cr, we compute an index ^;,t(o"), where <l>T,t(o-)(/) = ^^t* (o-))(<l'>pOfg.)(/)) for any /. 

Note that / e dom(Fi o Fq) if and only if / e dom(Fo) and Fo(/) e dom(Fi). Therefore, for such /, 
there are 7 < ao and k < a\ such that f ^ and Fo(/) e Uj^. Assume that / e dom(Fi o Fq) n and 

Fo(/) € Ul. It is easy to see that 4'*^ is computable, #{« € N : '¥*.^{f \ n + l) ^*j^{f t «)) < Po*/3i and 
#{*I'*^(/ t n) : « e N} < 70 * n- Moreover, there exist s and cq such that *P°(/ t = ^°(/ t ■5') = eo for 
any t > s. Fix such s. Since <D,o(/) = Fo(/) € Ul, for any t > s, #{t e E*{f [ t) : 4'|,(t) i= %{t-)] < /3i 
and #{T^(t) : t e £■(/ r 01 < n, since E{f \ t) = E{f t s) and by our choice of T^. Therefore, 
lim„ ^*^.{f [ n) converges to lun„ ^P^CFqC/ \ n)). However, there exist u> s and e\ such that ^|.(Fo(/ \ 

v)) = T|,(Fo(/ r ")) = e\ for any v > m, since {F()(/ \ m)}„>.v is an increasing sequence of strings and 
Fo(/) £ dom(Fi). Here <D„ (Fo(/)) - Fi(Fo(/)). Thus, 

%m„T,K/rn)(/) = %m„T*,(/r")(^iim„>p«(/r«)(/)) ^ ^iim„ i'i(ro(/))(ro(/)) ^ ri(Fo(/)). 

Consequently, Fi o Fq is (oro * a^ySo *y6ilro * yi )-computable, via {"^ j,k]j<aa,k<iyr ° 

Corollary 30. {^jY'p^^ forms a monoid under composition, for any a,/3, 7 e {1, < w, co]. 

Proof. Straightforward from Proposition 29. □ 
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Proposition 31. [C^rli;^^ is the smallest monoid including {^tV^' [^t'^Lk^j smallest monoid includ- 
ing V^t]\^\2' [Kt]^'^ is the smallest monoid including [Cylj," [Ky]^'^ is the smallest monoid including 

Proof. We first show that every {\,n + l)-computable function F can be represented as F = Fi o Fq for 
some (1, /i)-computable function Fq and (l,2)-computable function Fi. Let *F be a learner for F. We 
define a leai^ner for Fq and a leai^ner *Fi for Fi. For a given string cr e N^^'', let a* Q crbe the longest 
initial segment of cr satisfying #{t c cr* : T(t) ^(t~)) < n. Then, on cr, the learner *Po guesses an 
index of the partial computable function g t-^ g ® <^w(cT')(g), i.e., Fo(g) = <^^'Q(o-)(g) = g ® *^^(a-')ig) 
for any g e N^. Note that {n e N : ^o(g I n + I) i= 'Vig [ n)} < n for any g e Therefore, Fq 
is (l,n)-computable. For cr © t e N^, if cr* = cr then the learner guesses an index of the partial 
computable function g ® h h. If cr* cr, then guesses an index of the partial computable function 
g®h i.e., 0>p,(o-eT)te®/^) = ^^TCo-jfe). Since F is (l,?i + l)-computable, and by the definition 

of cr*, it is easy to see that Fi is (1, 2)-computable. For g e N^, if #{« £ N : YCg [ n + l)i=^'{g [ n)} < n, 
then 

ri(Fote)) = Fite®Fte))-F(g). 
If #{« e N : ln+l)i=^'{g [ n)} = n, then 

ri(Fote)) - Fi(g © (DT(r)(g)) = Tig). 

Consequently, F = Fi o Fq as desired. 

We next show that every {l,a)\n + l)-computable function F can be represented as F = Fi o Fq for 
some (1, a;|«)-computable function Fq and (1, a»|2)-computable function Fi. Assume that *F is a learner 
for F, and we enumerate {*F(cr [ n) : n < \cr\] as {i'j^j]m<\a-\- Here, if m < n then 4' guesses /JJJ before 
*F guesses i^ on some initial segment of cr. Note that, if cr c r and i^^ is defined, then = /,^,. On 
cr G M^^, if ^(cr) then 4'o guesses an index of the partial computable function g g ® (^^'(a-)ig)- 
Otherwise, *Fo guesses an index of the partial computable function g t-^ g ® ^i^ig)- Then, the partial 
function Fq identified by the learner *Fo is (1, a»|«)-computable. On cr © t e N^^ if ^(cr) i'^, then *Fi 
guesses an index of the partial computable function g®h ^ h. Otherwise, ^\ guesses an index of partial 
computable function g®h ^ ^^((T){g)- 

We show that every (« + 1, l)-computable function F can be represented as F = Fi o Fq for some 
l)-computable function Fq and (2, l)-computable function Fi. Assume that F is (n + 1, l)-computable 
via a collection {A;},<,; of partial computable functions. For g e N'^, if F(^) - A,(g) for some / < n, 
then Fo(g) = g® A,(^). Otherwise, we set Fo(^) = ^ ffi Ao(g). Then, clearly Fq is {n, l)-computable via 
[A^g.g © A,(g)};<„. For g®h e N^, if F(^) - Ai{g) for some / < n, then Fi(g © h) = h. Otherwise, we 
set Fi(g ®h) - Anig). Clearly, Fi is (2, l)-computable. Note that, if g e dom(F), then F(g) = A;(g) for 
some / < n. If F(^) - A,(g) for some / < n, then Fi(Fo(^)) = Fi(g © A,(g)) = A,(g). If Tig) = A„(g), then 
ri(Fo(g)) ^ Fi(g© A()(g)) = Anig). Therefore, Tig) ^ Fi oFofe) for any g 6 dom(F). By the similar way, 
it is easy to see that every (n + 1, (i»)-computable function F can be represented as F = Fi o Fq for some 
in, a»)-computable function Fq and (2, (x»)-computable function Fi. □ 

Corollary 32. {[£r]^_|^_ : a, /3, y < oj+l} contains just sevenmonoids, [£r]^|<^. [^t]^'^, 

[^t]1 [Crir. and [Crl^ 

Proof. By Proposition 26, we have [e^]},^ ^ [^t]\^,^ ^ [d^]},^ ^ [d^J^^I^ ^ [^rt^^; [d^]^^,^^ = 

[^r]i|<w' ^^'^ [^r^iii ~ l^^^^isly ^ < a),a)]. Moreover, by Proposition 26 and Proposition 

27, [C^rlJ^i'J' = whenever (J3,y) i= {aj,(jj}. Therefore, by Proposition 29 and 31, we have just seven 

monoids, [(Lt]\, [^rlL^ [^rl^K^- [^rl^' ^^rt, [^t]T^ and [dr]'^. □ 

When the classical disjunction P U Q (resp. PVoo2) is valid, say f e P U Q (resp. / e PVcoQ), then 
either / i-> 0"/ or / i-> l~f (resp. either / i-> 0~pro(/) or / i-> l~pri(/)) witness the validity of P © 2 
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Table 3. Seven monoids of nonuniformly computable functions 



intuitionistically. That is to say, the one-tape (resp. two-tape) intuitionistic disjunction is reducible to the 
classical disjunction via two total (resp. partial) algorithms. In general, we will see that each one-tape 
disjunction is decomposed by a total (i.e., truth-table, or Popperian) learners. 

Definition 33. Let D be a subset of Baire space N^, and a,fi,y < -i- 1 be ordinals. A function 
T . D is {a^ ,p~\y~)-truth-table if there are bounds a < a,z < min{yS, y), a set / c N of cardinality 

a, and a collection {p{e,k) : e € / & ^ < z) of indices of truth-table Junctionals (i.e., dom{Op(^e,k)) - N^) 
such that 

(1) (Popperian Condition) for any eel, there is ^ < z such that Ye(cr) = p{e,k). 

(2) r is (a",yS~l7~)-computable via the family {^e\eei- 

Here, we do not assume the uniform computability of the collection {p(e,k) : e € I & k < z}- If y = oj, 
then we simply say that F is {a , P)-tnith-table for (Q',y6|y)-truth-table function F. Let [K??]^ (resp. [£ff]^|^) 
denote the set of all (Q',yS)-truth-table (resp. (a,y0|y)-truth-table) functions. 

Proposition 34. Kq = = mAl,, = mAl^^^ = mAl < mA^'^ - mAT = mA'^ - 22'°, 

for each re {tt,T]. 

Proof. Every learner ^ determines just one learnable function F e [£7-]^. Therefore, [K^]^ is countable. 
For non-uniform computability, we first see #[£7-]^ < 2" since 

#(NN)N = 2^ ° by cardinal arithmetic. 
On the other hand, every function F : — > {0^, 1^} is (< a>, l)-truth-table via two constant truth-table 
functional Fo(/) = (f and Fi(/) - 1^ for any / e N^. Therefore, #[Q-„]^'^ > 2^'*°. □ 

Proposition 35. Let P, Q be subsets of Baire space N^. 

(1) There is a {I, n\l)-truth-table function F : |[P V G]Ilcm[„] P ® Q- 

(2) There is a {\,n\2)-computable function F : |[P V 2lLCM[)i] ~^ P ® Q- 

(3) There is a {\,n)-computable function F : |[P V GlLCM[n] ~^ P ®Q- 

(4) There is a (l , oj\2)-truth-table function F : |[P V QV^Qf^ -> P ® Q. 

(5) There is a (l,oj\2)-computable function F : |[P V 21lcm ~^ P ® Q- 

(6) There is a (l, co)-computable function F : |[P V GIlcm ~^ P ® Q- 

(7) There is a (2, l)-truth-table function F : |[P V QVq^ P ® Q. 

(8) There is a (2, \)-computable function F : |[P V 2]|q|_ P ®Q. 

Proof. For the items (1), (4), and (7), we consider the truth-table functionals Aq : / © ^ i-> Q~g and 
Ai : f®g^ l~g. By the definition of |[P V QIcl' obviously Ao(/®g) e P® 2 or Ai(/® ^) e P© 2 for 
any f ®g e QIq\_- Let cq and e^ be indices of Aq and Ai , respectively. On cr ® t e (2 x N)^'*, we set 
*P(cr ®t)- ea-{\a-\-\)- Note that the partial function F identified by the learner T is (1, ?i|2)-truth-table on 
|[PvG]licM[n]'ai^d(l,w|2)-truth-table on IPvei^cM" Moreover, clearly Y{f®g) = {\imj{s)rg e P®Q 

forevery/©g€ [Pvei^CM- 
For the items (2), (5), and (8), we consider the partial computable functions Aq : / i-> 0~pro(/) and 

Ai : / l"pri(/). By the definition of IP V Q]]^^, obviously Ao(/) e P © 2 or Ai(/) € P © 2 for 

any / e |[P V 21q|_. Let cq and e\ be indices of Aq and Ai, respectively. On cr e (2 x N)^^, we set 

^(cr) - e(o-(|o-|-i))Q. Note that the partial function F identified by the learner ^ is (1, n|2)-computable 
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on IP V GlLCM[n]' ^'^^ (l,6ti|2)-computable on IP V 21lcm- Moreover, clearly r(/) e P© g for every 

For the items (3) and (6), on cr e (N U {jj})'*'^, ^(o") guesses an index of the partial computable function 
g g"^'^"'\ where t(cr) = max{n : cr{n) = (j| + 1 if such n exists; otherwise, f(cr) = 0. Note that the partial 
function T identified by the learner Y is (1, ?i)-computable on |[P V 2]lLCM[n]' ^^'^ '^)-computable on 
IP V GIlcm- Moreover, clearly r(/) € P © 2 for every / e |[P V QIlcm- ^ 

Definition 36. Let P, Q be subsets of N^, and fix a,fi, y e {I, < a>, to}. Then, P is (a,fi\y)-reducible to 
Q (written P <^'|^ Q) if there is T e [£r]^|y such that T : 2 ^ P. We say that P is ia,/3\y)-equivalent 
to Q (written P =^|^ Q) if P <^'|^ Q and Q <^'|^ P. We also say that P /i' (a,/3\y)-truth-table-reducible 
to Q (written P <^^^|^ Q) if there is T € [G:?,]^!^ such that T : 2 ^ P, and that P is ia,f3\y)-truth-table- 
equivalent to Q (written P =;^^^|^ 2) if P <^,^|y 2 and G <^^|^ P. 

Proposition 37. F/.x' o-,/?, y e {1, < w). r/ie?i, <^^^ forms a preordering over P{M^). 



Proof By Corollary 30. □ 

:} and <^ 



Proposition 38. The preorderings <! and <'t' are equivalent to the Medvedev reducibility and the Much- 



nik reducibility, respectively. 

Proof. By Proposition 26 (4) and (5). □ 

Definition 39. Fix a,/3,y e {1,< a),a)}. Let -25^1^, ^J^yji^. ^|^> and f^f^^^y denote the quotient sets 
P{M^)/ =^|^, f (N^)/ =«^|^, n0(2^)/ =^|^, and n°(2N)/ respectively. Here, nO(2N) denotes the 

set of all nonempty n° subsets of 2^. For P G f (N^), the equivalence class {Q c : 2 =^|^ P} € 
is called the {a,/3\y)-degree of P. 

Proposition 40. For each a,/i,y e {1, < co,a)}, the order structures i)"t/s\y' ^\y' ^^'^ '^tt p\y f"^'^ 
lattices. Moreover, the disjunction operations |[- V -Ilcmp]' E' ■]Ilcm[2]' I' '^lcm' I' 'Ilcm' E' 'Ilcm' 
[[• V -J^i^, anJ [[• V -J^i^ are infimum operations on the structures <tj, •2)<cj. ^^f^|<tj' ^L|<w' -^^j' 
2)^'^, and T)'^^, respectively. In particular, U, V, V^, and Voo are the infimum operations on the structures 
f'tv ^<-' ^M<-' ««^^r' respectively 

Proof. By Proposition 35. □ 

Remark. Later we provide a characterization of our degree structures by iterations of the disjunction 
operations, in Theorem 156. 

Proposition 41. The degree structures D]^ and Oj^^ are Brouwerian. 

Proof Set B(P, Q) = {R cn^ : P <l R]. We need to a construct a function /3 : !P(N^) x 'P(N^) ^ 
?'(N'*) such that /3{P, Q) = minB(P, Q) for any PQ Q N^. Let A,, denote the e-th (1, 6j)-computable 
function, i.e., A^ig) = ^limn'v Agtn)ig) for any g e dom(At.)- Define yS as follows. 

m Q) = {e'g e : (V/ e Q) Kif (B g) e P). 

It is easy to see that yS(P, Q) e B{P, Q) for any PQc ¥F. If R e B{P, Q), say A, : Q ® R ^ P, then 

1 
1 



clearly e-g e /3(P, Q) for any g e R. Thus, /3(P, Q) <\ R. □ 



Remark. In contrast, later we will show that neither Dl, „ nor , , nor D":^, nor Df^^ form Brouwer 
algebras. See also Theorem 194 and 196. In the meantime, by Proposition 49, it is shown that there 
are Brouwerian modifications of Di, „ , Df^, and which look more natural than our original 
definitions, from the viewpoint of constructive mathematics. 
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For a sequence {(T„}„gN e (N ) of strings, lim„ cr,, is defined by (Iim„ cr„)(m) = Iim„(cr„(m)). If 
Iim„ cr„ : N ^ N is total, say Iim„ cr„ - /i e N^, tlien we say tliat lim„ cr„ e converges to h. 

Proposition 42. Fix an ordinal a < to. A partial function T :C is {\,a)-computable if and 

only if there is a total computable function ijj : N"*"^ N*^^ such that Iim„ \ n) converges to T{g), 
and #{n e N : if/{g f n + I) ^ if/(g [ n)} < a, for any g € dom(r). 

Proof. Assume that F is (1, Q')-computable via a learner ^. We put i/'(cr) = <1>'F(o-)(o") for each a e N"^^. 
Then the condition #{« e N : I n+l) t ^(g \ n)} < a implies #{« e N : i//{g [ n+l) ^ il/{g [ n)} < a, 
for any g e dom(F). Because if [ n + I) = [ n), then if/ig \ n) = 0>p(g^„)(g \ n) c ^^.(g^„){g \ 
n + \) = ijj{g \n + 1). Thus, clearly, lim„ \ n) converges to <^\,m„^(g\n){g) = ^ig)- 

Assume that F(g) = lim„ [ n) for any g £ dom(F) for some ^ satisfying the condition in Propo- 
sition 42. We define a computable function (^e(cr) '■ for each cr e N^-^. For any g € N^, 
put ^e(cr){g',n) = ip{g C s){n) for each n e N, where s > \cr\ is the least number such that if/{g [ s)(n) 
is defined. Clearly, 0^(0-) is partial computable, and indeed, we can compute an index e{o-) of <l>g(o-) 
uniformly in cr e N"^^. Then, we define a learner ^ inductively. Put ^«)) = e({}). Fix o" e N'^'^, and 
assume that ^(o"~) has already been defined. If i/'(o") 2 ipicr^), then set ^(cr) = *F(o"~). If ifria) ^ tfricr~), 
then set ^(cr) = e{cr). Clearly, the condition #{n e N : ip{g [n+l) ^ i^{g [ n)} < a implies 
#[n e N : *F(g [ n + I) [ n)} < a, for any g e dom(r). In particular, lim„ *F(g [ n) converges to 
some index e{cr) for any g e dom(r). Hence, <^\im„^ig\n){g) ^ \Jn>\a-\ ^ig \ n) = limnenHg I n) = Y{g), 
since [ipig \ n)}n>\cr\ is an increasing sequence of strings. □ 

Corollary 43 (de Brecht-Yamamoto [26]). A partial function F :C is (I, tD)-computable if and 

only if there is a computable sequence {F„j„eN of partial computable functions which converges pointwise 
to F on dom(F) with respect to the discrete topology on N^. 

Proof. By Proposition 42. □ 

Remark. Proposition 42 suggests that every (1, a>)-computable function F :C — > is also of Baire 
class 1 (indeed, effectively E^-measurable) with respect to both the discrete topology and the standard 
Baire topology on N^. Here, the effective E^-measurability is also known as the limit computability 
[10]. However, on Baire topology, not every effectively 1,^-mea.suTable function is (1, (jj)-computable. In 

fact, we can easily construct a computable function with a O'-oracle (which must be Ej'** -measurable) 
which maps a computable point to a 0' -computable point, whereas every (1, w)-computable function F is 
non-uniformly computable, i.e., F(x) <t x for any x € dom(F), as seen in Proposition 26. Moreover, not 
every (1, cti)-computable function is O'-computable, since we can also easily construct a discontinuous 
( 1 , CL»)-computable function while every function computable relative to some oracle must be continu- 
ous. Therefore, in the context of computability on Baire topology, {\,oS)-computability (leamability) 
is quite different from {i' -computability and limit computability. But, by this observation, the notion of 
leai^nability is rather expected to be a useful tool to the study of effective discontinuous functions. 

2.5. Nonuniform Computability on Falsifiable Problems. In this paper, we will mainly pay attention 
to the behavior of nonuniform computability on H^ subsets of Cantor space 2^. We first see that, if we 
restrict our attention to IT*' sets, then some reducibility notions collapse. 

Proposition 44. Let P be aU^ subset ofM^, and X be any subset o/N^. 

(1) X J P if and only ifX <{ P. 

(2) X <l<oj P if and only ifX P. 

(3) X<},^PifandonlyifX <l P. 

(4) P <l,^ X if and only if P <<- X 

(5) P X if and only ifP <<% X. 
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Proof. (1) See Simpson [61]. 

(2,3) Assume that X Q via a learner ^. From ^, we construct a Popperian learner ^* : N"^^ N, 
i.e., *P(cr) is an index of truth-table functional for each cr e N^^. We may assume that ^(cr) is defined, 
by Proposition 24. Let Tp be the corresponding computable tree for P. If cr ^ Tp, then ^*{o-) returns 
an index of the constant function / i-> 0^. If cr g Tp, then let *F*(cr) be an index of the following 
computation procedure. Given / e N^, at stage 5 e N, if o" ^ /, then returns 0^^. If / \ s eTp extends 
cr, and *P(/ \ t) = (T for any \cr\ < t < s, then simulate the computation of <I>t(o-)(/ \ s). Otherwise, for 
the least such stage s, returns 0>j/(o-)(/ \ s - 1)~0'^. Clearly, ^^*(a-){f) defines an element of N^, for any 
/ e N^. Moreover, agrees with Y on P, i.e., ^\im„^"(f\n){f) = <I>iim„T(/r«)(/) for any / e P. 

(4,5) Assume that P <Jj'^|<^ X via n Popperian learners, {*P,),<„. Given g e X, on the first challenge, 
our leaner A guesses that ^o(^ [~ 0) is a correct algorithm. As each is Popperian, and P is 11°, the 
predicate <l'To(gro)(^) e P is ITj. Therefore, whenever Ovj/g(g|^())(^) 6 P is incorrect, the learner A is able to 
understand that his guess is refuted. If it happens, the learner goes to the next challenge. On the {ns + i)- 
th challenge, A guesses that ^i{g \ s) is correct. By continuing this procedure, eventually A learns a 
collect algorithm to solve the problem P. Note that, if an {n, b, c)-computable function exists from X to 
P, then the learning procedure of A is stabilized before the («c)-th challenge starts, i.e., A determines a 
(l,?ic)-truth-table computable function. □ 

Corollary 45. {<^^|^ n (11° x 11°), <^^^|^ n (11° x n°) : a,l3, y € { 1, < aj,aj]} contains at most nine pre- 
orutrtngs. r^^^p , r^^^, :;<^, ^^^j, anu u 

Remark. We may introduce the notion of Popperian learning on Baire space N^. Let P,QQ N^, and 
/ : 2 ^ P is a learnable function via a learner *F. The procedure of the learner 4' is described as 
follows. On an observation cr e N*^^ with [cr] D Q G), a. learner *F conjectures that e is a correct 
algorithm computing a solution of P from cr, that is, <I>t(o-)(/) - ^eif) ^ P for any future observation 
f e Q D [cr]. If 2 is n°. Proposition 44 (3) suggests that we may assume that e is an index of a total 
computable function. Then, the learner ^ can find mistakes of his hypothesis on P if P is also a 11° subset 
of the Baire space N^. Therefore, restricting to 11° subsets is expected to be an analogy of Popperian 
learning. In this context, the usual Popperian learning on total computable functions could be regarded 
as a learning process on 11° singletons. 

Definition 46. Let D be a subset of Baire space N^, and a,p,y < a» + 1 be ordinals, or eff, where 
eff" - eff. We generalize the (Q'",/3",7~)-computability as follows. If or = eff, then we revise the 
word "for any g e D, there is e e /" to the word "there is a partial computable function Bq :C 
such that, for any g e D, for e = Bo(g)". If yS = eff, then we revise the mind change condition as 
#{« e N : *Pe(g \ n + l) ^^(g [ n)} < Bi{g), where Bi is a computable function from to N. If 
y = eff, then we revise the eiTor condition as #{^eig t n) : n eM] < B2{g), where B2 is a computable 
function from N*^ to N. For new notions, <^|^, ^)^|^, and 'P^|^ are also defined as the usual way. 

Proposition 47. Suppose that, ifr = eff, then let t* mean the symbol < co, and otherwise, set t* = t. 
Then, every (a, /3,y)-computable function with a compact domain is (a* ,/3* ,y*)-computable. 

Proof. By continuity of Bq, Bi, and B2 in Definition 46, {Bj^Hl^DleeN for each / < 3 is an open cover of 
D. Hence, by compactness of D, we have the desired condition. □ 

Corollary 48. ^P^,, = P],^; ^P^,^,, - Pl^^^; Pf' = 'P<^; and Pi'' = P<^. □ 

That is to say, for 11° subsets of Cantor space 2^, no new reducibiUty notion is constructed from 
Definition 46. However, from the perspective of intuitionistic caluculus, our new notions in Definition 
46 have nice features. 

Proposition 49. ^Lieff ^' '^"^ ^^^^ 

are Brouwerian. 
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Proof. Fix a, 13, y e{\,< oj, eff, oj}, and set B{P, g) = {/? c : P <||^ Q®R}. We need to construct a 

function yS : ?'(N'^) x y'CN^) ^ ^PCN'^) such that 2) - min B(P, 2) for any P,QQ N^. Let A, denote 
the e-th (1, C(j)-computable function, and be the e-th partial computable function from to N. Put 
change^(g) = #{neM: A^(g \n + \)i^ K{g \ n)}, and eiTor,(g) = #[K{g t ") : « e N}. Then, 

[ {{e, dTg : (V/ e Q) Kif ®g)eP& change,(/ (B g) < @,{f ® g)}, 

if(a,Ar) = (l,eff,w), 
{{e, dTg : (V/ e Q) A,(/ ® e P & eiTor,(/ ® ^) < ©,/(/ © 

if (a,yS,r) = (l,w,eff), 
{ J-g : (V/ e Q){3e < 0(/ © g)) 0,(/ ® g) e P), 

if(a,;S,r)-(eff,l,a;), 
{J-^ : (V/ e 0(3e < 0(/©^)) A,(/©^) € P}, 

if (Q',yS,7) ^ (eff,a>,a;), 

It is easy to see that /3(P, Q) e B{P, Q) for any P, 2 c N*^. For the minimality, if P e B{P, Q), we have 

-1 
-1 



m Q) 



suitable d and e such that (J, e)"^ € yS(P, g) for any g e P. Thus, y6(P, 2) <} P. □ 



Remark. Unfortunately, neither "P^^^ nor 'P^jgff nor ^^^^^ nor ^f^^^ form Brouwer algebra. See Theorem 
194 and 196. 

The Medvedev reducibility <} , the leai^nable reducibility <^, and the Muchnik reducibility <^ could be 
viewed as analogues of the intuitionistic implication, the LCM implication and the classical implication, 
respectively. In this way, <[ is interpreted as algorithmical reducibility with no mind-changes. Then, 
how the classical reducibility <^ behave as a learning procedure? 

Proposition 50. For any n'/ set P c and any set 2 c P <^ 2 if and only if 

(3Y)(V/ £ Q) <Dlin.inf„«F(/r«)(/) ^ 

Here ^ ranges over all learners (i.e., computable functions from N"^^ to Nj. 

Proof. The "only if" part is obvious. For the "if" part, we will inductively define ^{cr) and /(cr, e) for 
each o" e N^*^ and e £ N. Let Tp denote the corresponding tree for P. First, put ^«)) = and /((), e) = 
for each e. Now assume that, for any t e N*^^ with |t| < |o"|, we have already defined ^PCr), and /(r, e) for 
each e e N. Then, we define ^(cr) and Z(cr, e) for each e as follows: 



lip-, e) 



jfie < |cr| [Oe(cr) I {l{cr ,e) + I) eTp] if such e exists, 
1 |cr| otherwise 

fZ(cr-,e) + l ife-*P(cr), 
1 /(cr" , e) otherwise. 

By our assumption P <^ 2, luninf„*P(/ t «) exists for all / e P. Thus, the desired condition 

f lim inf„ >P(/ rn)(/) ^ 2 holds. □ 

Remark. Recall that a subset of 2^ is 11° if and only if it is the set of all infinite paths through a 
computable subtree of 2"^^. Thus, in our model of inductive inference, each learner tries to learn a 
program for an infinite branch of T from a given infinite branch of another tree T* . Another model of 
branch learning has been studied by Kummer-Ott [47], and Ott-Stephan [56] in which each learner tries 
to learn a program for an infinite computable branch of T from the global information about T. They 
pointed out that the concept of branch learning is equivalent to learning winning strategies for closed 
computable Gale-Stewart games, since the class of IIj subsets of 2^ correspond exactly to the class 
of winning strategies for such games (see also Cenzer-Remmel [22]). Case-Ott-Sharma-Stephan [18] 
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explains the concept of branch learning by using a temperature controller trying to keep the temperature 
in a room between 18°C and 22°C. In their model, each learner tries to learn a program for an infinite 
computable branch of T from the global information about T with an additional information about one 
infinite branch ofT, i.e., the leaner may watch a human master. A k-v/ise variation for branch learning 
called weak k-search problem has been studied by Kaufmann-Kummer [46]. 

3. Degrees of Difficulty of Disjunctions 

To separate the strength of superintuitionistic disjunctions, a rather exotic IIj set constructed by 
Jockusch and Soare is useful. We say that a set A c N*^ is an antichain if it is an antichain with re- 
spect to the Turing reducibility <j. In other words, / is Turing incompai^able with g, for any two distinct 
elements f,geA. A nonempty closed set A c N'^ is perfect if it has no isolated point. 

Theorem 51 (Jockusch-Soare [45]). There exists a perfect 11° antichain in 2*^. 

A stronger condition is sometimes required. For a set P c and an element g e N'^, let P-^^ denote 
the set of all element of P which are Turing reducible to g. Then, a set A c is antichain if and only if 
^<Tg - {g} fQj- every g e A. A set P c is independent if P-t®'^ - D for every finite subset D c P. 

Theorem 52 (see Binns-Simpson [8]). There exists a perfect independent 11° subset of 2^. 

On the other hand, in the later section, we will see that our hierarchy of disjunctions collapses for 
homogeneous sets, which may be regarded as an opposite notion to antichains and independent sets. 

3.1. The Disjunction ® versus the Disjunction U. Recall that a set P c is special if it is nonempty 
and it contains no computable points. 

Lemma 53. Let Pq, Pi be 11^ subsets of 2^, and let Q be a special IIj subset of 2^. Assume that there 
exist / e Po and g e Pi with Q^Tm = Q<Tf y Q<Tg ^uch that Q-^f and Q-^^ are separated by open 
sets. Then 2 ^} (Po ® 2^) U (2^ ® Pj). 

Proof Suppose that Q <\ (Pq ® 2^*) U (2^ ® PO via a computable functional <D. Then f®g e (Pq ® 
2^) U (2^ (g Pi). By our choice of / and g, 0(/ ® g) must belong to Q^^f^s = Q<Tf y Q^Tg By our 
assumption, Q-^^ and Q-^^ are separated by two disjoint open sets U,V c 2^. That is, Q-^^ c U, 
Q-^^ c y, and ?7 n V = 0. Therefore, either 0(/ © g) e 2 n ?7 or 0(/ ®g)^Qr\V holds. In any 
case, there exists an open neighborhood [cr] 3 0(/ © g) such that [tr] c U or [cr] c W . Without loss of 
generality, we can assume [cr] c U . We pick initial segments tq <z f and t\ <z g with <1>(to ® t\) 2 cr. 
Then (to"0^) © g e (Pq ® 2^) U (2^ ® Pi), and it is Turing equivalent to g. However this is impossible 
because <D(to~0'^ © g) € [cr], and [cr] n Q-^^ QUn Q-^^ = (d. □ 

Corollary 54. (1) There are n° sets P, 2 c 2^ such that P U Q <\ P ® Q. 
(2) There are sets P, g c 2^^ such that P =<'^ Q and P <\ Q. 

Proof (1) Let P be a perfect independent IT',' subset of 2^. Set P = 2^ ® P and 2 = P (8> 2^. Note that 
P © 2 =} P. Pick f,geR such that f i= g. Then P^^^ - {/}, P^^« = [g], and P^?^/®« = R^rf y R<Tg = 
{/, g]. Since R is Hausdorff, two points / and g are separated by open sets. Thus, P ® Q =\ R ^\ P ^ Q 
by Lemma 53. (2) P © 2 =^,"^1 P U Q <\ P ® Q. □ 

3.2. The Disjunction U versus the Disjunction v. 

Lemma 55. Let Po,Pi be n*' subsets of 2^, and let Q be a special IIj subset of 2^. Assume that there 
exist / e Po and g € Pi such that any h € Q-^^ and Q-^^ are separated by open sets. Then Q ^! Pq~Pi. 
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Proof. Suppose that Q <} Pq^P\ via a computable functional O. By our choice of / e Pq £ P^fPi, 
there must exist an open set J7 c 2^ such that <!>(/) e Qf\U and Q-^s n U = Q. Since U is open there 
exists a clopen neighborhood [cr] 9 0(/) such that [tr] n 2 £ ^- We pick an initial segment re/ 
with <1)(t) 2 o". Since / e Pq holds, we have that t e Tp^, and we pick p € Lp^ extending t. Then 
p~g € Pq~Pi, and p"g is Turing equivalent to g. So, if Q <} Po~Pi via then 0(p"g) must belong to 
Q-^^. However this is impossible because (S>(p'g) e [cr], and [cr] n Q-^^ QUO Q-^^ - 0. □ 

Corollary 56. There are sets P, Q c 2^ such that P' Q <\ P Q <\ P ® Q. 

Proof. Assume that 7? be a perfect n'^' antichain of 2^. Sei P = 2^ ® R und Q = R® 2^. Pick f,g e R 
such that f i= g. Then R-^f = {/) and R-^^ ^ {g} since R is antichain. Therefore, (P U Q)-^^ c 
{{X] ® 2^) U (2^ (g) {X}) for each X e {/, g). For /i = /iq ® /ii e (P U 2)^^^', we have ho + g and hx + g. 
Thus, /i ^ (2^ ® {g\) U ({g} ® 2^), and note that (2^ ® {g\) U (\g\ ® 2^) is closed. Then, there is an 
open neighborhood [/ c 2^ such that h e U and U n (P U Q)-^^ = 0, since P U 2 is regular, and 
(P U Q)-^s c (2^^ ® {g}) U ({g} ® 2^). Namely, any he{PU Qf^f and (P U 2)-^^ are separated by some 
open set. Consequently, by Lemma 55, we have P U 2 ^} P~2. □ 

Let P^Q and P^Q denote [{o-d-r -.creTp&Te Tq}] and [{o-r -.o-eTp&Te Tq]], respectively. 
Recall from Proposition 21 that P~Q =\ P^Q. However, there is a (1, l)-difference between P~Q and 

p^e- 

Proposition 57. There are H^ sets P, Q c 2^ such that P^Q<\P'Q. 

Proof It is easy to see that P^Q <\ P^Q for any P,Q Q N^. Let 7? c 2^ be a n° antichain. Then 
we divide R into four parts, Pq, Pi, Pj, and P3. Put P = P3, and Q = ((0, l>~P2~Po) U «l)''P2''Pi). 
Without loss of generality, we may assume that (0) € Tp. Suppose that P^Q <\ P'^Q via a computable 
function <1). Choose g € P2. Then we have (0, l)~g e P^Q. Therefore, <1>((0, \ )~g) e P^Q must contain 
fj, since P = P3 has no element computable in g e P2. Thus, there is n € N such that O((0, \)~{g \ n)) 
contains (Jj, /) as a substring for some / < 2. Fix such /. Then, O((0, \)~{g \ n)) e P^{Q n [(/)]). We 
extend g I n to some leaf p of P2. Choose /i^; e P^ for each k < 2. Then, (0, l)~p~/jo £ G £ P'^G, 
and <0, 1)~p~/Ji e (0)^2 c P'^Q. Thus, (D«0, ITp^hu) must belongs to P^Cg n [(/)]), for each k <2. 
However P~*iQ n [(/)]) has no element computable in (0, l)~p~/ji_,-. A contradiction. □ 

3.3. The Disjunction v versus the Disjunction v^. Let 4' be a learner (i.e., a total computable function 

: ^ N). A point a e N^^ is said to be an m-changing point of^ if #{5 e N : ^{a \ s + \) 
"Via \ s)} > m. Then, the set of all wi-changing point of ^ is denoted by Change>j/(> m). A point a e 
is anti-Popperian with respect to ^ if lim„ ^{a [ n) converges, but <I>iim„'F(at«)('^) partial. The set of 
all anti-Popperian points of ^ is denoted by AP>j/. 

Remark (Trichotomy). Let F be a ( 1 , (x>)-computable function identified by a learner and let P be any 
subset of Baire space N^. Then \F"^(P) is divided into the following three parts: the set F"'(N^ \P); 
the 1° set APxp; and the H^ set HmeN Change,j,(> m). 

We say that Pq and Pi are everywhere (a>, \)-incomparable if Pq n [ctq] is Muchnik incomparable with 
Pi n [0-1] (that is. Pi n [o-;] Pi_,- n [o-i_;] for each / < 2) whenever [cr,] n P; ?t for each / < 2. 

Theorem 58. Let Pq, Pi be everywhere (a>, l)-incomparable H^ subsets of 2}^, and p be any binary string. 
For any (l, ca)-computable function F identified by a learner *P, the closure o/Changexj;(> m) U F~^(N^ \ 
Po ® Pi) U APvj/ includes p^{Pa^nP\T with respect to the relative topology on p~{Pa^m+nP\T (as a 
subspace of Baire space N^j. 

Proof. Fix a string p^tq which is extendible in the heart of p~{PqV„P]). Then, pr,(To) must be extendible 
in Pj. Fix f e P, n [pr,(To)] witnessing Pi_; P, for each / < 2, i.e., Pi_,' contains no /i-computable 
element. Such f exists, by everywhere {oj, l)-incomparability. Assume that f = pr,(To)~y]* for each 
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/ < 2 and that the last declaration along tq is 70, i.e., tq = Tq^Cjo,^) for some k < 2. Then we can 
proceed the following actions. 

• Extend tq to ^0 = To-write(jo,/p £ p~{PoVnPi). 

• Wait for the least sq > \to\ such that (l)>F(go \so)(go I ■^o; 0) = jo- 

• Extend go \ so to gi ^ (go \ 5o)"write(7i,/p e p"(PoV„+iPi), where 71 ^ 1 - 70. 

• Wait for the least > such that <l>>F(g, Ui)(Si t ■^'i ; 0) = 1 - 70. 

If both So and si are defined, then this action forces the learner Y to change his mind. In other 
words, gi € Change,j,(> 1). Assume that si is undefined for some 1 < 2 Note that gi =7 /,-,, since 
pTjiigi) = fji and pri_y,(g/) is finite, for each I < 2. Therefore, T(gi) ^ (1 - ji)~Pi-ji since Pi-j, has 
no ^/-computable element. In this case, gi e r"^(N^ \ Pq® Pi)- Hence, in p~{Po^n+iPiT , the closure 
of Change,y(> 1) U r~'(N^ \ Pq ® Pi) U APxp includes p~(PoV„Pi)''. By iterating this procedure, in 
p~{Po^,n+nPi)'^, we can easily see that the closure of Changexj,(> m) UF^'CN'^ \Po®Pi) U APvp includes 
p-(PoV„Pif. □ 

Corollary 59. 

(1) There exists n° sets P, g c 2^ such that Pv^Q Pvg. 

(2) There exists sets P, 2 c 2^ such that P =^|_,^ Q and P <l,^ Q. 

Proof. (1) Let P be a perfect 11 j antichain in 2^* of Theorem 51. Fix a clopen set C such that Pq = 
P DC (D, and Pi - P \ C + (b. Then every / € Pq and g e Pi are Turing incomparable. Therefore, Pq 
and Pi are everywhere (w, l)-incomparable. Let p„ denote the n-th leaf of the tree Pcpa of a Medvedev 
complete set CPA c 2^. Fix a (1, m)-computable function F identified by a learner By Theorem 
58, Pm+i~(PoV,„+iPi) intersects with Change,j,(> m + 1) U F^^^'^'^ \ ^0 ® ^i)- Thus, Pq © Pi 
0r(^oV„Pi). Additionally, we easily have PqV^Pi ®^{Pi)^nPi)- (2) P - 0,7(^oV„Pi) and 
e ^ Po ® Pi are lf[. □ 

3.4. The Disjunction v^^ versus the Disjunction Voo. 

Theorem 60. Let Pq, Pi be everywhere (oj, \)-incomparable IIj subsets of 2^. For any (l,a))-computable 
function F, the complement ofT~\Po ® Pi) is dense in (PqVooPi)^ (as a subspace ofBaire space N^j. 

Proof. Fix a learner ^ which identifies the (1, oj)-computable function F. Fix any clopen set [t] inter- 
secting with the heart of (PqVooPi). Assume that [t] n (PoVooPi)^ contains no element of F~^(N^ \ 
Po ® Pi) U APvy. By Theorem 58, Change,j,(> n) is dense and open in the heart of (PqVooPi) n [t] = 
T'iiPo n [pro(T)])Voo(Pi n [pri(T)])). As [r] n (PqVooPi)'' is n',', the intersection n«eN Changevp(> n) 
is dense in [t] n (PqVooPi)^, by Baire Category Theorem. Hence, \ F"'(P() ffi Pi) intersects with any 
nonempty clopen set [t] with [r] n (PqVooPi)'' 0- o 

Corollary 61. 

(1) There exist n° P, 2 c 2^^ such that P =^'^ Q holds but Q il P holds. 

(2) There exist n° sets P, 2 c 2^ such that P = Q holds but P <l Q holds. 

Proof. Let P be a perfect Hj antichain in 2^ of Theorem 5 1 . Fix a clopen set C such that Pq = P n C 0, 
and Pi = P \ C Then Pq and Pi are everywhere (w, l)-incomparable. Fix a (1, a>)-computable 
function F identified by a learner ^. By Theorem 60, N*^ \ (Pq ® Pi) is dense in (PqVcoPi)''. For H'j' sets 
Po, Pi £ 2^, both PoVeoPi and Pq ® Pi are rf^', and PqV^Pi <} Pq ® Pi . □ 

3.5. Infinite-Tape Models. This subsection is concerned with degrees of difficulty of infinitary disjunc- 
tive notions between the intuitionistic infinitary disjunction and the classical infinitary disjunction. 

Definition 62. Fix a collection {P,},e/ of subsets of Baire space N^. 
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Figure 1 . The two-tape (bounded-errors) model of disjunctions for independent 11" sets 
P, Q c 2*^. 

(1) IV/e/^/lint = {/ e (/ X N)N : ((3/ e /) pr,.(/) e Pi) & mc(/) = 0}. 

(2) IV/e/ AIlcm = 1/ e (/ X Nf : ((B/ e /) prK/) e Pi) & mc(/) < oo). 

(3) IWieiPilcL = {/€(/ X Nf : (3/ € I) pr,.(/) e Pi). 

Proposition 63. Let {P„}nev. be an infinite collection of subsets ofBaire space N^. 

(1) EV«EN AJint ^nenPn, where 0„,N^n = K«>V ■ f ^ Pni 

(2) IV/,,, Pi Alcu =\ IPq V PiUlcm- ^^^^^ " 'P'/'^'' ^^^'^ ' < 2 « e N. 

Proo/ (1) |[V„eN^"]lint >1 0„6N^« witnessed by / i-^ (/(0))o''pr(/(o))o(/), and |[V«eN ^nlim <1 
0neN^" is witnessed by / write(/(0),/^^), where recall that write(/(0),/^^) - (/(O))^ © 
{An.f{n + l)) denotes the infinite sequence <(/(0),/(l)), (/(O), /(2)), . . . , (/(O), /(«)), (/(O), + 1)), . . . > 
which indicates the instruction to writing the infinite word on the /(O)-th tape. 

(2) We first construct a computable function 5 witnessing EVf.n A>1lcm ^} \Po V PiIlcm' ^'^'^ 
((/, n), v) e (2 X N) X N, we first set n), v))) = <((/, n), v)>. For each string cr € ((2 x N) x N)<^ 

inductively assume that H(cr^) has been already defined. Assume cr = cr {{{i,n),v),((j,m),w)). If 
{i,n) = (j,m), then we set H(o") = 5(a"~)~(w). Otherwise, we set H(o") = H(o"")~(tj, j, w). For any 
/ ^ IVi.n A>1lcm7 the backtrack symbol f| occurs in S(/) finitely often, since mc(/) < oo. Therefore, 
tail(H(/)) converges, and tail(H(/))"~^ = pr,„i(/) € P, for some / < 2 and m e N. Thus, e 
IPoVPil^^^. 

We next construct a computable function H* witnessing |[Vi,« P(>1lcm ^} EPo V PiIlcm^ ^*iO) = 
(>. For cr = cr <v, w) e (N U {(i))^^, inductively assume that E*{cr~) has been already defined. To 
define H*(cr), recall the definition count(cr) = #{n < |o"| : cr(n) = ji}. In the case that v ft and 
w ft, we let S*(cr) be the concatenation of H*(cr~) and (((tail(cr; 0), count(o")), w)). Otherwise, we 
set E*{cr) = E*{o-~). For any / e |[Po V PiIlcm' 1^^^^ mc(S*(/)) < oo, since count(/) = #{^ e 
N : f{k) = ff} is finite. Therefore, we have pr(taii(j.o),count(/))(S*(/)) = tail(/)^^ e Ptaii(/;0)- Thus, 
H*(/)e|[V,>^'>3LCM. □ 

We again use the consistent modifications of infinitary models, [Vt^] gjsj^" ~ EVneN^nlLCM ^ 

Con(rpJ„gN, and [Voo]„eN^« ^ EVneN^nlcL H Con{TpJrieN- 

Proposition 64. Let {P„}„gN be a computable collection o/II? subsets ofBaire space N^. 



Recall that 0,7^ P,i is the recursive meet of computable collection {P„},!ei<j of TIj subsets of 2^ defined 
by 0,7^ P,i = CPA~{P„}„gN - CPA U \JnPn~Pn, where p„ is the length-lexicographically ?i-th leaf of 



(1) CV^eN^JLCM^! [V.Ln^«- 

(2) CVneN^JcL^l NcleNPn- 



Proof. As in the proof of Proposition 16. 



□ 
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the corresponding computable tree of the Ilj set CPA c 2 consisting of complete consistent extensions 
of Peano Arithmetic. 

Proposition 65. For any computable sequence {Pn\nm of nonempty n*' subsets of 2^, =<cj 

Proof. The condition <} ®neN^« witnessed by a computable function n^g i-> Pn~g. We 

will construct a learner witnessing ><w ®nen^"- ^ computable function : CPA ^ 

0"P(). Such exists, since every nonempty 11° subset of 2^ is (1, l)-reducible to CPA. We also fix a 
partial computable function 0,(„) : Pn~g ^ n~g, for each « e N. For cr e 2*^^, if cr e Tcpa then set 
^((t) = e.lf cr ^ TcpA, then p„ c cr for some n. For such n, we set *F((t) = i{n). The function F identified 
by the learner ^ is clearly (1, 2)-computable, and F(^) e Pn for any g e Pn- □ 

When comparing these infinitary disjunctions, it quickly becomes clear that the bounded reducibility 
notions <' ,, <\ , and <f'^ are useless. Moreover, it is easy to see the following. 

Proposition 66. Let {P„}„ev. be an infinite collection of subsets ofBaire space N^. 

(1) ®nPn [V.I/n- 

(2) e„P„^r [Voo]„^«- 

Proof. The computable function i-> write(?i, g) = © g witnesses ^„Pn >} [V^j] ^« ™d 
^„ Pn >} [Vco ]n ^n- Fix a partial computable function 0,(„) : g i-> ?i~pr,j(g), for each « e N. Clearly, 
for any g € [Voo]„^"' there is « £ N such that <I),(„) e ^^P,,- We construct a learner *F witnessing 
0„^« [V^],/«- For - (T~^{{n,w)) e (N x N)<n, set ^((t) - /(n). For any g e [V^]„ Ai> the 
learner T changes his mind finitely often along g, and <l>iim,T(gr.v)te) ^ ^'i- ° 

Therefore, the only comparison that is left is between the intuitionistic infinitary disjunction ^ and the 
classical infinitary disjunction under the (1, a>)-reducibility. To understand the difference between 
degrees of difficulty of ^ and Voo > the notion of a learning process by a team of learners is useful. Note 
that the infinitary disjunctions , and SJ^ are not subsets of 2^ (indeed, not compact), even if all 

Pn, « e N, are FIj subsets of 2^. Therefore, it may be rather suitable to compare two compact 11° sets 
0p Pt and 0p(PoVco ■ ■ ■ VcoP,), for n° subsets P, c 2^, f e N. When one think of P„ (resp. 
[Voo ]„ Pn) as an intuitionistic (resp. classical) interpretation of arithmetical existential quantifier (B?i)P„, 
then 0/PoV 

CO • • • ^ oo Pt) can be interpreted as calculating a bound t such that {3n < t)Pn is classically 

valid. 

Proposition 67. Let {Pn]nm be a collection o/IIj subsets of2^\ Then, the set 07~*(-foVco ■ ■ ■ VooPr) is 
computably homeomorphic to a Hj subset of 2^. 

Proof. It suffices to show that 0(^(PoVco ■ ■ ■ ^coPt) is computably bounded, that is to say, there is a 
computable function /i : N ^ N such that g{n) < h(n) for any element g e 07^(PoVco ■ ■ ■ VcoP?). Note 
that PqV^ . . . V^P, c ((? + 1) X 2)^, and Ipyl > t. Hence, we have g{t) < 2'+^ for any ? e N. □ 

3.6. The Disjunction versus the Disjunction . A sequence {.^CilfeN of elements of N*^ is Turing 
independent if x,- is not computable in 0y-t; xj for each / £ N. A collection {P,),e/ of subsets of N'^ is 
pairwise everywhere independent if, for any collection {[cr;]},g/ of clopen sets with P,- fi [cr,] t for each 
/ e /, there is a choice e YiieiiPi ^ [ci]) such that P, has no element computable in 0jg/\|,j xj for 

each i e I. 

Theorem 68. Let {P;};<2' be a pairwise everywhere independent collection o/IIj subsets of 2^, and let 
p be any binary string. For any (t, oS)-computable function F, the complement ofY'^{Po ® ■ ■ ■ ® P21-1) is 
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dense in the heart ofp'~(PoVco ■ ■ ■ Vco/'2'-i) (as a subspace ofBaire space N'^j. Indeed, for any nonempty 
interval I in the heart of p~{PoVco ■ ■ ■ "^ooPi'-i), there is g e p~{PqVco ■ ■ ■ Vc»^2'-i)^ n / \ r~^(Po ® • • • © 
P2'-i) which is computable in some g* € ^i^^2'-i ^k- 

Proof. Assume that the CL))-computable function F is identified by a team {T,},<< of learners. Fix a 
string p~To which is extendible in the heart of p~{Po^co ■ ■ ■ VooP2'-i)- Then, pr,(To) must be extendible 
in Pi for each / < 2^ Fix {/i},<2' £ Y\i<2'(Pi ^ [P^i(To)]) witnessing the independence of {P,),<2', i-S-, 
Pi contains no /,-computable element. Assume that f = pr,(To)~/j.* for each / < 2' and that the 
last declaration along tq is 70 < 2', i.e., tq = T^~(jQ,k) for some k < 2. Fix a computable function 
6 mapping j < 2' to a unique binary string 5{j) satisfying j = ligIo2^ • 5{j;e). Let E^^ denote the set 
{] < 2' : e) - k}. Then we can proceed the following actions. 

• Extend tq to ^0 = T"o"writeOo,/* ) e p"(PoVoo ■ ■ ■ VooPr-i)- 

• Wait for the least sq > \to\ such that ^^'F^feo [■io)(^o T ■^'o; 0) £ ^s(jg e) some e < 2'. 

• If such So exists, then enumerate all such e < 2' into an auxiliary set Cho, and define ^(ji) as 
follows: 

\6ijo;e) if Cho, 
\l-d{jo;e) ifeeCho. 



<50'i ; e) 



• Extend go [ so to gi ^ (go I 5o)~write0'i, /p e p (PqVco - ■ - Voo/'y-i), where 71 = ZUo^" ' 
S(jue). 

These actions force each learner ^'e with e e Cho to change his mind whenever the learner want to 
have an element of ®,<2' u eM. Assume that ju, gu, Su, and Ch„ has been already defined, and 

the following induction hypothesis at stage u is satisfied. 

• prgfc) £ fe for any e < 2', hence, gu e p~(PoV P2'~lf n [p'Tol 

• {sv]v<i, is Strict increasing, and Ch„ 0. 

• For each e e Ch„, if ^^'^(g„ [s„)(gu t Si,;0) converges to some value k < 2', then k e E^^^j .^^ 

It is easy to see that u = satisfies the induction hypothesis. At stage u + I e N, we proceeds the 
following actions. 

• Define as follows: 



S(ju+ue) 



\6(ju;e) if^-^Ch,,, 
\l-S(ju;e) iff'eCh,,. 



• Extend g„ t ^« to g„+i = (g„ t s„)~writeO„+i,/|"'^^^), where ^ Zl-o^" ■ S(iu+i\e), and 

satisfies pr,. - pr^- ^,(g„ \ s.^f'j^^^^ = p-fi.,r 

• Wait for the least Su+i > s^ such that Ovp^(g„^i Uu+i)(8u+i \ Su+\ ; 0) e E^fj^^^^-e) ^'^^ ^ < 2^ 

• If such Su+i exists, then enumerate all such e <2' into Ch„+i, 

By our action, it is easy to see that m + 1 satisfies the induction hypothesis. As p"(PoVco • - • VcoP2'-i)^ 
is closed (with respect to the Baire topology) and {siJueN is strictly increasing, the sequence {^„l„eN 
converges to some g e p~(Po^co ■ ■ ■ VooP2'-i)^- Let 1(g) c 2' be the set of all e < 2' such that prg(g) is 
total. 

Claim, g <T ®,ei(g) fe- 

Note that g - g\_fo, ■ ■ ■ ,/2'-i] is effectively constructed uniformly in a given collection {fk)k<2'- In 
other words, there is a (uniformly) computable function mapping {fk]k<2' to @({fk}k<2') - g = 
g[/o: • • • ,/2'-i]- Then, it is easy to see that the function maps {fe]eei(g) U {pre(g)~0^)eg2'\/(g) to g. 
Hence, g <t ®eei(g) fe ® ©e62'\/(g) PJ^e(^)"0^- Therefore, g <t ^eeiig) fe desired, since pr^(g)"0^ 
is computable for any e €.2' \ 1(g). 
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Let Fg denote the (1, 6j)-computable function identified by that is, Te(a) - (^\im„ ^'{atn)((^) for any 
a € N*^. We consider the following two cases. 

Case I {e e Ch„ for finitely many u e N). Fix u such that e i. Ch,, for any v > u. For each v > u, 
^^^{g\s„){& \ ■^uiO) does not converges to an element of E''^^ . .^^ = E^^^j .^y By our definition, for each 
k ^ E^g^j .^y P^kig) ^ P fk is finite. By previous claim, g <t ^g^j^fe- Thus, by independence, has 
no ^-computable element. If Ovj/^(j|-v„)(g I Si,;0) f for any m e N, then g e APvy^. If lim„ *Fe(g [ n) 
does not converge, then g e HmeN Change>j/ (> m). Otherwise, (^\ira„^ Ag\n){g',^) converges to some 
value k i E^^j^^.^y As <^\im„^Agtn){g) is g-computable, we see <^iim„^AgMig) € k'Pu. Consequently, 
geW'\Y:\^,^^,Pu). 

Case 1 {e e Ch„ for infinitely many u e N). We enumerate an infinite increasing sequence {u\n\}neH, 
where u\n\ is the n-th element such that e e Ch„. As e e Ch„[„], we have (^^>Ag\u[n\){g \ u{n\;G) e 
^6(Hn]\ey action, 6{ju[n^i];e) = 6{ju[n]+i;e) + d{iuVn\\e). This imphes £'^(^-,j,_^jj.g) n = ©■ 

However, we must have Ag\u{n^\\){g \ u[n + 1];0) e E^^^j ^ ^^.^y since e e Ch„[„+i]. This forces the 
learner 4'^ to change his mind. By iterating this procedure, we eventually obtain g e HmeN ChangCvp (> 
m). 

Consequently, g e Oeeni^^ \ ^e\®k<2'Pic)). Thus, g e \ r;H©;t<2' ^aO- For any tq such 
that p~To which is extendible in the heart of p"(PoVco ■ ■ ■ VcoP2'-i)> we can construct such g extending 
Tq. Therefore, \ F^ '(©^,^,, P^) intersects any nonempty interval in p~(PoVoo ■ ■ • VooPi'-i)^- In other 
words, N*^ \ Fj^(Po © • • • © Pi'-i) is dense in p~(PoVc» ■ ■ ■ VcoP2'-i)^ as desired. □ 

The following theorem by Jockusch-Soare [45, Theorem 4.1] is important. 

Theorem 69 (Jockusch-Soare [45]). There is a computable sequence {Wn PJjlieN of nonempty homoge- 
neous IIj subsets of 2^ such that |x,)igN is Turing independent for any choice Xj e Y\n P'w ' ^ 

Clearly any such 11° set contains no element of a PA degree, a Turing degree of a complete consistent 
extension of Peano Arithmetic. Accordingly, every element of such a 11^ set computes no element of a 
Medvedev complete 11 j set CPA. 

Corollary 70. There are Xf^ sets P„ c 2^, « € N, such that ©p(PoVco . . . VooP,) <^'^ ©p Pf 

Proof. Fix the computable sequence {P,};gN of Theorem 69. Then {PilieN is pairwise everywhere in- 
dependent. Assume that Pt ©7^(PoVco ■ ■ ■ ^ooPt) via a <D)-computable function F. Let 
p„ denote the «-th leaf of the tree Tcpa of a Medvedev complete n'l* subset of 2^. By Theorem 68, 
r"kUj(:<2' Pk~Pk) is dense in the heart of P2'~(Po^oo ■ ■ ■ VooP2'-i)- In particular, there is an infinite path 
CO ■ • ■ ^oo Pi'-i) such that F(^) ^ U/t<2' Pk Pk which is computable in some g* <t (K)yt<2' Pk- 
By our choice of ^ig) computes no element of [Jk>2' Pk U CPA. Thus, T{g) ^ Pt- D 

Corollary 71. 

(1) There exists a computable sequence {Pn\neH o/IIj subsets of Cantor space 2^, such that the 
condition [Vco ]„ Pn ©„ Pn is satisfied. 

(2) There exist n° sets P,Qq2^ such that P Q holds but P Q holds. 

Proof (1) By Corollary 70. the condition [Voo ]„ Pn <\ ©pCPoVoo . . . V«,P,) <r ©P P, <\ ©„ Pn 
is satisfied. (2) Put P = [\] ^ P„ <} ©p(PoV«, . . . VeoP,) and Q = ©p P,. Then P and Q are (1, 1)- 
equivalent to 11° subsets, by Proposition 67. By Theorem 70 and Proposition 66, P <^'^ Q='^ P. □ 
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4. Contiguous Degrees and Dynamic Infinitary Disjunctions 

4.1. When the Hierarchy Collapses. We have already observed the following hierarchy, for pairwise 
independent 11° sets P,Qc2^. 

P®Q>\PUQ>\PVQ Pv^Q >l^^^ Pv^Q ^^'^ P®Q. 

Homogeneity is an opposite notion of antichain (and independence). Recall that S c is homoge- 
neous if S = Yln^n for some 5,, c N, « e N. Every antichain is degree-non-isomoiphic everywhere. 
On the other hand, every homogeneous set 5 is degree-isomorphic everywhere, that is to say, 5 n C is 
degree-isomorphic to S n D for any clopen sets C,D c with S nC ® and with S C\D + The next 
observation is that our hierarchy collapses for homogeneous 11° sets, modulo the (1, < a>)-equivalence. 

Theorem 72. For every homogeneous 11° set S c 2^ and for any 11° set Q c 2^, if S Q then 

s <L Q- 

Proof. Let S = O y ^.v for some n° sets Fx c {0, 1). Assume S <<'^ Q via the bound b. That is, for every 
g ^ Q there exists an index e < b such that <l>e(^) e S . Let us begin defining a learner ^ who changes 
his mind at most finitely often. Fix g € Q. ^ first sets Aq = e N : e < Zj). By our assumption, we 
have Og(g) e S for some e e Aq. Then the learner ^ challenges to predict the solution algorithm e < b 
such that Oe(^) € 5 by using an observation g € Q. He begins the 1-st challenge. On the (s + l)-th 
challenge o/*P, inductively assume that, the learner have already defined a set A , c Aq. Let v be a stage 
at which the s + 1-th challenge of ^ on g begins. In this challenge, the learner Y uses the two following 
computable functional F and A. 

• For a given argument x, T(x, s + I) outputs the least {e{x), t(x)) such that e(x) e Ag and Oe(^x)(g \ 
t(x); x) i if such {e{x), t{x)} exists. 

• If F(x, s+l)^ {e{x), t{x)), then A(g; x,s+\) = ^e(x){g \ t{x); x). 

Set Ai+i(g;x) = A(g;x, s + 1). Clearly, an index d{s + 1) of A^+i is calculated from s + I. Then 
the learner *F(g \ v) outputs d{s + 1) on the {s + l)-th challenge. Hence <l)>f(g|-v)(g; x) - ^d{s+\){g',x) - 
^e(x){g r t{^)\ ^) for any x. He does not change his mind until the beginning stage v' of the next challenge, 
i.e., ^^•{g\v"){g) = ^^(gik)ig) for k <v" < v' . The next challenge might begin when it turns out that *P's 
prediction on his (s + l)-th challenge is incon^ect, namely: 

• ^>F(g|-i')(§ r ") t n ^ Ts^u for some n < u at some stage u > v. 

Here Ts is a coiTcsponding computable tree of 5. For each x e N, fix a decreasing approximation 
{^x.vl veN of a n° set Fx £ {0, 1), uniformly in x. In this case, there exists x < n such that the following 
condition holds. 

^"Pfewte [ u;x) = A,+i(^;x) = <^e{x){g;x) i. 
For such a least x, the learner removes e{x) from A,, that is, let A ^+i = A^ \ {e{x)\. If A^+i + then 
the learner *F begins the {s + 2)-th challenge at the current stage u. The construction of the learner Y 
is completed. An important point of this construction is that the learner never uses an index rejected on 
some challenge. This makes the prediction on g e 2 of the learner *P converge. 

Claim. ^ changes his mind at most b times. 

Whenever ^ changes. A, must decrease. However #Ao = b. 

Claim. For every g e Qit holds that Oiini,>p(g|^.v)(g) e S . 

For g e Q, let B« c Aq be the set of all e e Aq such that (^eig) e 5 = Yi.x P^x- By the definition of 
Aq, clearly is not empty. Moreover, c n.v^.v holds, since e is removed from Cl^As only when 
Oe(g;x) ^ Fx for some x. Thus, ^^'(g\v)ig) : N ^ N is total for every stage v. This means that, if 
^^ig\v)ig) i S , then the learner ^ will know his mistake at some stage u, i.e., <l>>p(g[-v)(g [ u;x) ^ Fx^u 
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for some x < u. Then some index is removed from Hs^i- However, this occurs at most b times. Thus, 

%m,>P(^;wte) e 5. □ 

Let a,p,y e {1, < a),a)}. We say that a (a,y6|7)-degree a of a nonempty 11° subset of 2^ is {a,p\y)- 
complete if b < a for every (Q',y6|'y)-degree b of a nonempty n*' subset of 2^. If a ITj set P c 2^ has an 
(Q',y6|'X)-complete (Q',y6|y)-degree, then it is also called {a,l3\y)-complete. 

Corollary 73. A subset of^^ is (1, < io)-complete if and only if it is {l,oj\ < a))-complete if and only 
if it is (< (jj, \)-complete. 

Proof. Let DNR2 denote the set of all two-valued diagonally noncomputable functions, where a function 
/ : N ^ 2 is diagonally noncomputable if f{e) 4^ Oe(e) for any index e. This set is clearly homogeneous, 
and n^. Moreover, it is (1, l)-complete (hence (a,yS|7)-complete for any a,^, y € {1, < a*}). Therefore, 
we can apply Theorem 72 with S = DNR2. n 

Corollary 74. There are ITj sets P, 2 c 2^ such that P ® Q =\^^ P^coQ- Indeed, if P is homogeneous 
and Q =\ P, then P ® Q =\^^^ P^ caQ is satisfied. 

Proof. Let P be any homogeneous IIj subset of 2^. Then P©P is also homogeneous. By Proposition 35, 
there is a (2, l)-computable function from PVcoP to P © P, hence P ® P <^'^ PVooP. Thus, by Theorem 
72, P © P PVooP. If 2 P, then, by Proposition 14, P © 2 ={ P © P <^.^ PVc«P =\ PVooQ. □ 

It is natural to ask whether our hierarchy of disjunctive notions for homogeneous IIj sets also col- 
lapses modulo the (1, \)-equivalence. The answer is negative. We say that a homogeneous set n,i Pn is 
computably bounded if there is a computable function / : N — > N such that P„ c {0, . . . , /(«)} for any 
n e N. Clearly, every homogeneous subset of Cantor space 2^ is computably bounded. Cenzer-Kihara- 
Weber-Wu [19] introduced the notion of immunity for closed sets. A closed subset P of Cantor space 2^ 
is immune if Pp^' has no infinite computable subset. 

Theorem 75. Let P c 2^ be a non-immune ITj set, and S q, S i, . . . , S ,n c N be special computably 
bounded homogeneous sets. Then Ui<m •^z ^1 ^■ 

Proof. Let Vq be an infinite c.e. subtree of Tp"". Assume that lj,<„, Yln^'n ^\ P via a computable 
functional O, where, for each / < m, {P',)„ew is a uniformly 11^ sequence of subsets of {0, 1, . . . /,}. Let 
Sf denotes the corresponding n° tree of [!« and let L; = {p : (3t e Sf){3i) p = T'ii) i Sf\, for 
each /. Note that L,- differs from the set of leaves of the corresponding computable tree of Oh P\v We first 
consider the set = {p e L,- : (Bcr 6 V,) <I>(cr) 2 p}, where V,- for < / < m will be defined in the below 
construction. Note that Lj^ is computably enumerable. There are three cases: 

(1) is infinite; 

(2) is finite, hence O([yo]) is a subset of n„ K'^ 

(3) otherwise. 

(Case 1): For any n, there exists p e of height > n + \, and p{n) e From any computable 
enumeration of Lq we can calculate a computable path of This contradicts the specialness of 

(Case 2): There exists a finite number k such that, for every string o" e Vq of height > k, <l>(cr) belongs 
to S^'^'. This also contradicts the specialness of 5o = On ^n- 

(Case 3): There exists infinitely many strings o" e such that <l>(cr) extends some string of Lq . Since 
Lg is finite, by the pigeon hole principle, there exists po € Lq such that 0(cr) extends p for infinitely 
many cr e Vq. Fix such po, and let Vi = {cr e Vq : •l>(cr) 2 p). Then the downward closure of Vx is an 
infinite c.e. subtree of Tf, and 0([Vi]) n So = 0. 

By iterating this procedure, we win the either of the cases 1 or 2 for some / < m. The reason is that, 
if the case 3 occurs for 7, then Vy+i is defined as an infinite c.e. subtree of T^p^ such that 3>([yi]) n 
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([Ji<jSd = 0. Since U,<m UnK <\ P < [V,„], i.e., c \Ji<^Si, the case 3 does not occur for 

m. □ 

Corollary 76. Let P, Q be any nonempty IT ^ subsets of 2^, and S,T be computably bounded homoge- 
neous n° sets. Then S i\PvQ. 

Proof. Clearly PvQ is not immune. Thus, Theorem 75 implies 5 U T ^[ P^Q. □ 

To understand degrees of difficulty of disjunctive notions, and to discover new easier (possibly infini- 
tary) disjunctive notions, it is interesting to discuss contiguous degrees. 

Definition 77. Let (a,/3,y),{a* ,f3* ,y*) e {1,< oj,a>}^, and assume that <^|^ is not stronger than <^.*|y.- 
An (Q',y6|y)-degree a™ is (a* ,/3*\-Y*)-contiguous if a™ contains at most one (Q'*,/?*|'y*)-degree, that is to 



say, for any representatives A,Be a^|^, we have that A is (a*,/3*|y*)-equivalent to B. 



ply >-t""i5i*L't*j ii "^ly 

;prese 

Corollary 78 

(1) There is a {l,< co)-contiguous (< oj, \)-degree o/Hj sets of 2^. 

(2) Every (1,< oS)-degree which contains a homogeneous IIj set or a IIj antichain is not (1, 1)- 
contiguous. 

(3) Every (1, Ct»| < a))-degree ofU^ antichains is not (1, < oj)-contiguous. 

(4) Every (< a),\)-degree o/ fl j antichains is not {\,(jS)-contiguous (hence, is not < oj)- 
contiguous). 

Proof. (1) This follows from Theorem 72. 

(2) If d is a (1, < (D)-degree of a homogeneous set S , then d contains S and S vS , since S 5 . 
However, 5vS<}5'US=Sby Corollary 76. If d is a (1, < (jj)-degree of a 11° antichain P, then d 
contains {Px2^)U{2^^ xP) and PvP, since P (Px2N)U(2NxP). However, PvP <} (Px2^)U(2NxP) 
holds by Lemma 55. 

(3) Note that, for any 11° set P and any clopen set C, it holds that (P n C) ® {P \ C) =[ P. Let 
d be a (l,(x»| < a»)-degree of a Hj antichain P. Fix a clopen set C such that Pq = P C\ C %, and 
Pi = p \ C ^ 0. Then d contains Pq ® Pi and 0,7(PoV„Pi), since Pq © Pi =^|<^ 07(^0 v„Pi). 
However, ©7(P()V„Pi) Pq ® Pi holds by Corollary 59. 

(4) Let d be a (< cj, l)-degree of a Hj antichain P. Fix a clopen set C such that Pq = P n C 0, 
and Pi = P\C (b. Then d contains Pq ® Pi and PoV^^Pi, since Pq ® Pi =^'^ PqV^jPi. However, 
Po'^cjPi <i Po ® ^1 holds by Corollary 61. □ 

4.2. Dynamic Proof Models. In the classical proof process, a verifier Y on "Pq or Pi" may change his 
mind infinitely often. In the backtrack-tape model, this situation means that ¥ chooses the backtrack 
symbol (( infinitely many often. Then the word on A is eventually finite, and it verifies neither Pq nor 
Pi. Therefore, in the model, if ^ succeeds to verify "Pq or Pi" then the backtrack symbol |j occurs 
on the record A at most finitely often. Consequently, in the backtrack-tape model, classical verification 
coincides with LCM verification. However, we would like to cover the case that infinitely many mind- 
changes occur. This may be archived by regarding the backtrack-tape model as a kind of infinitary tape 
model. 

The dynamic-tape model: Assume that a directed graph (V, E) is given, where V can be infinite, E c 
V xV, and an initial vertex e € V is chosen. For any v eV, let adj(v) - {w e V : {v,w) e E). When a 
verifier tries to prove that "Vvev P\"^ infinite tapes □, and A^ for v e V are given. The tape □ is called 
the declaration, A^, is called the working tape for each v e V. First the letter s is written on □, and no 
word is written on A^, for v e V. At each stage s, assume that v[s\ is written on □. Then the verifier ^ 
executes one or the other of two following actions. 

(1) ^ declares some w e adj(v[5]), erases all words on □, and writes w on □; or 
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(2) ^ writes a letter ^ e N on the working tape A^.^s] ■ 
Assume tiiat a verifier ^ tries to prove that "Pq or Pi". 

• Intuitionism: Consider V ^ {s,0,l],E ^ {{s, 0), (e, 1)), and P^ ^ 0. 

• LCM with ordinal-bounded mind-changes: For a computable well-founded tree V = T Q 
N^^, consider the following. 

Po, if |cr| is even, 



E = E{T) = {{cr, t) e r X r : (3/ £ N) T - cr'i], = 



if \cr\ is odd, 



• LCM: Consider V ^ W, E ^ {{n,n + \) : n e N); P2,, = Po for any « e N; and P2„+i ^ Pi for 
any « e N. Moreover, the word written on the declaration □ must converge. 

• (V, £')-relaxed Classical: {V, E) = {Vq, Vi,E) is a given directed bipartite graph, and Pr - Pi for 
any t £ V,- and / < 2. 

Definition 79 (Consistent Dynamic Disjunctions). Let G = (V,E) be a directed graph, {Pvlvev be a 
computable sequence of 11° subsets of N^, and Pp,, be the con^esponding tree for Py. For E c 

E^EU{{v,v} -.veV]. 

(1) VveiviD^Pv - {/ e (V X N)N : (V« e N) {{{f{n))o,{f{n + l))o) e I) & (3v e V) pr,,(/) € 
P„) n Con(rp„)„ey. 

(2) T,e(y,£)Pv = {/ e (y X N)N : (V„ e N) «(/(«))o, (/(« + l))o> € E)} n ConCPpJ^^y. 

Here, recall that, for x = (xq, xi), the first coordinate xq is denoted by {x)o. If Pv = P for any v eV, then 
we simply write Viev ^ ^^i^ ▼vevP for VieCKS) ^'^^ ▼ve(y,£)A' respectively. 

As our dynamic-tape model is an infinitary-tape model, this model may be natural to be regarded as 
expressing a proof process of an infinitary disjunction Vi ev ^v- Therefore, we refer the model with {V, E) 
as an infinitary disjunction along (V, E). Later we will introduce a more complicated model. It will be 
called the nested-tape model. We first see an upper and lower bound of the degrees of difficulty of these 
disjunctive notions, and a relationship among various models we have introduced. Let Deg(P) denote the 
Turing upward closure of P, i.e., Deg(P) = {g : (3/ <t g) f € Pj, and [V] denote the set of all infinite 
paths through a graph (V,E), i.e., [V] = {p e V'^ : {p{n),p{n + 1)) e E\. 

Proposition 80. Let (V, E) be a computable directed graph, and {Pvlvev be a computable sequence o/IIj 
subsets ofU^. 

(1) D^(e,,^P„) <} Vve(Ki?)^v <\ ®,.,yPv. 

(2) Deg([V] e ©,,v^v) <\ ▼ve(K£)A. <1 [V] ® ©,,,vPv. 

Proof. (1)V ve(V.E) <\ 0vey is witnessed by v~ f ^ write(v, /) - v^®/. For any / e Vve(y,£) ^v, 
we have pr,,(/) e Py for some v eV. Thus, we have pr,,(/) <r f, since pr,, is partially computable, and 
/ e dom(pr,,). Hence, / e Deg(Pv). 

(2) Fix / € [V] © ©,,gy Pi- If /(O) - 1, then we can show the desired condition as in (1). If / is of the 
form f ^'g, we have An.{g{n),0) e 'Wve{^i,s)Pv since g e [V]. Hence, 'Wve(v,E)Pv <\ © 0,,gvPv 
To see Deg ([V] © 0,,gy Pi) <[ ▼ve(K£)A" we inductively define a partial computable function walk :C 
{V X N)^ ^ as follows. Set walk((» = <>, and fix cr = o— ((m, m), (v, «)> e (V x N)<^. Assume 
that walk(cr~) has been already defined. Then, walk(o-) is defined as follows. 

walk(cr~)~(v) ifvi^u. 



walk(o- {(u,m),(v,n))) 



walk(o" ) otherwise. 



For any / e ^ve(V,E)Pv, if P^vif) is total for some v e V, then the desired condition follows as in 
(1). Otherwise, mc(/) = 00, i.e., there are infinitely many ?i € N such that (f(n + l))o 7^ ifin))o. In 
this case, walk(/) = |J ^gj,j walk(/ [ s) is an infinite path through the graph (V, £). In other words, the 
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condition / e ^ve(V,E)Pv ensures that pr,,(/) is total and belongs to P,, for some v e V, or otherwise 
walk;(/) is total and belongs to [V]. Consequently, / e Deg^[y] ® ®vey^^')' ^^^^^ P^v walk are 
partial computable. □ 

Proposition 81. Let P, Pq, Pi , P^, for v eV, be 11° subsets o/N^, uniformly. 

(1) Vve(T E(T))Pv = ^ ve(T,E{T))Pv for any well-founded tree T c N*^-^. 

(2) Po©Pi =\ VveiVuE^Pv =\ ▼ve(y,,£,)Pv, where Vi = {s,0, 1), = {(e,0),(£, 1)}, and P, = 0. 

(3) PoVPi =} Vve(V2&) A. ^! ^ve(VuE,)Pv, where P^ = 0, Poi - Pi, Pio - Po, V2 = {s,0, 1,01, 10}, 
and E2 - {(e, 0), (s, 1), (0, 01), (1, 10)}, . 

(4) lPovPdl^^\V„^aoMio,mPv. 

(5) IPo V PiIlcm ^1 Vve(NS)'Pv, where S = {{n,n + I) : n € N}; P2,, = Pq and P2„+i = Pi for any 
neM. 

(6) IPyPllcM =1 EVneN^lLCM ^ Vve(N,S)^- 

(7) Deg(©,,^j,P„) ^} EVveN^vlcL Vve(N,N^) A. [V»].,N^v. 

Proof. (1) By Definition, Vv^v - ^vPv On the other hand, any / e ▼ve(r,£(7'))Pv can pass at most 
finitely many vertices since (T, E(T)) has no infinite path. In other words, the set {(/(?i))o : « e N} is 
finite. By Pigeon Hole Principle, there is a vertex v e T such that ifin))o = v occurs for infinitely many 
n e M. Then, pr,,(/) must be infinite. Therefore, pr,,(/) e [PpJ = Pv since / e Con(rp^,),,gy. Hence, 
/ ^ Vve(r,£(r)) Pv- 

(2) The condition VvefVi e,)Pv ^1 Po ©Pi follows from Proposition 80 (1). For any / e Vi.e(v, £1) 
there is / < 2 such that (/(«))() = i for any n e N. Thus, /~/ € Pq © Pi. The (1, l)-equi valence of 
^veiVi El) Pv ^i^d ^ve(Vi,Ei)Pv follows from the item (1) since (V\,Ei) is finite. 

(3) Clearly, P0V2P1 c Vve(y, £2) ^^v- Thus, by Proposition 22 (2), PqVPi >j Vvecv^ £2) ^P^" ^or 
/ e Vve(V2,E2)Pv, if l(/(0))ol = 1 then 0(/) - / € P0V2P1. If |(/(0))ol = 2, say (/(0))o = (ij), then 
0(/) = write(7, pr j{f)) € PqViPi. Hence, PqVPi <j Vve(y2 £2) via the computable function The 
(1, l)-equivalence of Vve(yi £1) Pv ▼ve(yi,£i)Pv follows from the item (1) since {V\,Ei) is finite. 

(4) It is easy to see that Vve({0,ii,{0,ii2) - ^oVooPi- Moreover, IPq V PiUql ={ PoVooPi by Proposi- 
tion 16. 

(5) For each a = T~{{i,m),{j,n)} e (N x N)^'*, we inductively define a computable function S(cr) as 
follows. If / = j, then we set H(cr) = H(t~((/, ni)))~(?i). Otherwise, we set H(cr) = H(t~((/, m)))~(((, 7, 
Then, |[Po V PiUlcm ^\ Vv€(n,5)^v is witnessed by H. Conversely, to see Vv€(n,5)^v <j [Po V PiDlcm' 
we again inductively define another computable function H*(o"), for each cr e (N U {((}). Set H*(()) = (), 
fix o- = a' - ~{j,k} e (N U {tt})"^^, and assume that E*{cr~) has been already defined. For w > v + 2, 
we consider the instruction move(v, w) = <(v + 1, 0), (v + 2, 0), . . . , (w - 2, 0), (w - 1, 0)) e (V x N)"'~''^^ 
to move from the tape A,, to the tape Ah, in the dynamic tape model. If w < v + 2, then we assume that 
inove(v, w) is the empty string. Put p{cr) = 2 ■ count(cr) + tail(o";0), where recall that count(cr) = 
#{n < |cr| : o-{n) = fl}. U j i= ^ and )t ^ J, then we define H*(o-) = E* (o-' )- mov eip{o-* ), p{o-)r{(p{o-),k)), 
where cr* is the last string E*{cr*) 2 E*({cr*)~). Otherwise, we set E*{cr) = E*(cr~). Then, we have 
{{E*{f; n))o, (5*(/; n + l))o) £ S for any / e [Po V Pi^lcm" ^^^y ^ ^^^ify that E*{f) e Vv6(n,s) Pv 

(6) The (1, l)-equivalence of [P V PJ^^^ and IVneN^PI LCM follows from Proposition 63 (2). Thus, 
the desired condition follows from (5). 

(7) Clearly, [VvsnAJcl n Con{TpJ„e¥i = Vve(N,N2)^v- Thus, the equivalence IVveN^vDcL =\ 

Vve(N,N2) Pv =\ [Voo IveN ^v foUows from Proposition 16 and 64. Deg (UveN ^v) Vve(N,N2) Pv follows 
from Proposition 80 (1). We may assume that <l>e(()) = () for each index e € N. We inductively define a 
computable function F witnessing Vve(NN2) Pv ^\ Deg (UxeN ^v)- For each a 6 N^'* and e e N, we also 
inductively define two parameters actg(cr) e N and rqg(cr) € N U {-1}. Here, acte(cr) will represent 
the last stage at which the e-th strategy acts along a, and rq^(o-) > will indicate that the e-th strategy 
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Figure 2. The dynamical representations of disjunction operations: (1) |[P V QJ\ni {P ® 
ex (2) P-Q; (3) IP V eiLCM[2] (^^2); (4) IP v eUci (^^ooG); (5) IP V Qil^^; (6) 
Deg(P), the Turing upward closure of P. 

requires attention. First we set act^(()) - and rqg(()) - -1 for each e e N. Inductively we assume that 
r(cr"), act^(cr~), and rq^Xo" ) is already defined. Calculate r - min{rqg(o-") : e < |o"| & rq^Ccr") > 0), 
and pick the least e such that rq^,(cr") = r if such r and e exist. In this case, we say that e acts. 
If there is no such e, we set r(cr) - r(cr~), act^(fr) - acte(cr"), and rqg(cr) - rq^Xo" )- If there 
is such e, put cr* - ((D^(o-))'-l'i>.(^riact,(cr)|)|^ ^ ^ |act,(o-)|)|)-cr*. Then we set 

r(cr) = r(cr")~write(£', cr*). Then, put rq^Ccr) = -1 and acte(a-) = \o-\. For each e N \ {e}, set 
acV(cr) - act(,.(o-"). Moreover, if e* < \cr\, rqg.(cr") = -1, and \(S>e'{cr \ |acV(o")|)| < |Oe.(o-)|, then 
declare rqg.(o") - |o"|. Otherwise, put rq^,.(a") = rqg.(cr~). Fix g e N^. We claim that <^e{g) act infinitely 
often whenever 0^(g) is total. Our construction ensures that only finitely many e's require attentions 
along g t 5 for each s e N. Therefore, for R - [e : r(\^{g \ s) > 0}, ii e e R, then the strategy e 
acts by stage s + #R, i.e., acte(g I s + #R) > s. Assume that e act at stage f e N. Then the algorithm 
T(g I t) writes the new information {g \ t)* of Og(g) on the e-th tape, i.e., ^T^(Y{g \ t)) = Oe(g I t). 
Thus, eventually, we have prg(r(g)) - (^dg)- For any g e Deg(lJveN there is an index e e N such 
that <^e{g) £ Pv for some v e N. Consequently, r(^) e Vve(N,N2) ^v- □ 

Proposition 82. Let (V, E) be a computable directed graph, and {Pv]vev be a computable sequence o/n^ 
subsets of^^. Then we have the following. 

(1) Vve(K£)A./^2:0. 

(2) T,e(v,£)Pv n?. 

Proof. Clearly, Con(rp^,),,gy is 11°. Moreover, the relation ((/(?i))o, {f{n + l))o) e £ is computable, 
uniformly in / e (N x N)'^ and n 6 N. Thus, Tve(y,£)Pv is n°. The relation pr„(/) e A- is n° in v € V 
and / e N^, since it is equivalent to the following formula. 

(V« € N)(3m £ N) |pr„(/ \m)\>n8c pr,.{f f m) e Tp^,. 

Therefore, Vve(y,£) is Sj. □ 

4.3. Concatenation, Dynamic Disjunctions, and Contiguous Degrees. 

Tiieorem 83. For any set P,QQ 2^, Q~P does not (1, \)-cup to P. That is to say, for any R c N^, if 
P <\ {Q-P)®RthenP <\ R. 

Proof. Fix a computable tree Vp (resp. Vq) such that [Vp] = P (resp. [Vg] = 2), and let Lp (resp. Lg) 
denote all leaves of Vp (resp. Vq). For a tree T c 2"^^ and g e N^, we write T (g) {g) for {cr © r : cr e 
Vp &. T ^ g &.\o-\ - |t|). For computable trees S and T, we also write 5 "T for 5 U UpeLj P" P^ where L5 
denotes the set of all leaves of S . Assume P <} (Q~P)<S>R via a computable functional <I). We construct a 
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computable functional I* witnessing P <j R. Fix g & R. Then we will find a g-c.e. tree c Vp without 
dead ends. To this end, we inductively construct a uniformly g-computable sequences {D^),g^, {Sf |,g^ of 
g-computable trees, as follows. 

El = VQ^{g]- D^ = (l)(£^). 

^f+i = (Vq~D^) ® {g}; = <^(El^). 

Here ^(E^) denotes the image of E^^ under a functional O, namely, <l>(£'f ) = {t c 2^^ : (Bcr e f^) t c 
0(a")). Finally, we define a g-c.e. tree = IJn^n- Now, we let W be the tree Vq^Vp, and then we 
observe [W] = Q-P and Vq c 

Lemma 84. For any i, Df c Vf and £f c W"' ® {g}. 

Proof. This lemma is proved by induction. First, our assumption Vq c W''^' ensures E^^ - Vq® [g] c 
and we also have - ^{El) c vp^' since ^{{Q-^P)®R) c [Vp] implies 0(W"'®te}) c Vp 
for g € R. Assume the lemma holds for each j < i. We now show that the lemma also holds for / + 1. By 
assumption, ^^"D^ c Vq^V^^' = W"". So by definition of £'f^j, we get c ty"' ® {g}. Furthermore, 
we observe Df^j - ^(E-^i) £ ® ig)) £ Vp"- □ 

Lemma 85. There is a computable function F mapping each g e R to a g-computable sequence r{g) = 
{Dn}necj of g -computable trees. 

Proof. We inductively show this lemma. It suffices to show that we can construct D? from E^^ by 
uniformly g-computable way, since clearly E^ is computable in g, and i-> E^^^ is uniformly g- 
computable. Assume that £"? c 2"^^ ® [g] is given. For each cr e 2^^^, if cr © t |o"l) ^ , then put 
/(cr) - |(D(cr ® (g [- |o-|))|. If o- © (g r |o"l) ^ £'f , then put /(cr) = oo. Note that / : 2<^ ^ N U (co) 
is g-computable, since the notation <l>(cr) just means the computation of restricted to step \cr\ with the 
oracle cr. By Lemma 84, lim„ /(/ [ n) = oo for any / e 2^. Because, for any / with / © g £ [E^], we 
have 0(/ © g) e [^(^f )] c <^{[W] ® c ^{{Q-P) ®R) c P, hence, / © g £ dom((I)). Therefore, by 
compactness, for each n £ N, there is /z„ £ N such that Z(cr) > n for each cr £ 2^^ of length h„. We can 
compute /zf («) = with the oracle g, since / is g-computable. Here, we can compute a g-computable 
index of h^ from an index of E^, uniformly in / £ N and g £ N^. Thus, the relation r £ is equivalent 
to the g-computable condition that r c <l)(cr) for some cr £ of length /j^(|t|), uniformly in / £ N and 
g £ N^. Formally, the set {(t, /, g) £ 2<^ x N x : r £ Df } is computable. □ 

Define Lq, as the set of all leaves of the tree Z)?, and define Le^ as the set of all leaves of the tree 
for each /. 

Lemma 86. Let X be D or E, and i be any natural number For any p £ , there are infinitely many 
nodes t e Li. which are extensions of p. 

Proof. This lemma is proved by induction. First we pick p £ Le^ = Lq® {g\ = {cr ® t : cr ^ Lq 8i t <:l 
g & |cr| = |t|}. We note that Vp is an infinite tree since P is special. By using our assumption P <} 
{Q'P) ® /? via <D and the property [Vq] ® {g} c (2"P) ® R, the tree = <I>(£'q) has a path, i.e., it is 
infinite. By definition, we have E^^ = Vp~D^ 2 P~^o' ^"^^ has infinitely many extensions of p. 

Now, we assume this lemma for E and any j < i. For a given p e Lq., there is a node a e E^ such that 
0(cr) = p by our definition of = f^(E^j). Without loss of generality, we can pick cr as a leaf of E^. By 
induction hypothesis, cr has infinitely many extensions in E^^^. By lemma 84, we know Ef^^ c W"'®{g}. 
This implies that ^{E^^^Cd cr)) must be infinite whenever £^f+i(2 cr) is infinite. We now remark that, for 
any cr' e 0(£'^^j(D cr)), O(cr') 3 0(cr) = p. Thus, <l>(£'^^j(2 cr)) gives infinitely many extensions of 
p, and our definition D^^j = (l)(£'?^j) clearly implies the lemma for D and /. Now, we will show the 
lemma for E and / -i- 1. By our definition of S^^j = {Vq~D^^) ® {g}, every p £ L^.^, must be of form 
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p = (cr'r) ® (g I IfT^rl) for some cr e Lq and t e Lq.. So if t e Lq. has infinitely many extensions in 
Li,.^^ then p = (cr~T) © f |o"~t|) has infinitely many extensions in L^.^^- Thus, we have established the 
lemma for E and / + 1 . Now, the lemma follows by induction. □ 

Lemma 87. is a g-c.e. subtree ofVp without dead ends for any g & P. Hence, has a g-computable 
path of Vp. 

Proof. For a given g-c.e. tree = {6s}seo, we first compute A(D^)[0] = Sq. If A(D^)[f] has already 
been defined, then we wait for stage s with 6s 2 A(D^)[t]. At this point, we extend A(D^)[f + 1] to 
(Ts. We eventually reach this stage since Vp has no dead ends. This procedure is g-computable and 
A{DS) - Urn, A{D^)[t] must be a g-computable path of D^. □ 

Then we define a computable functional *F as = A(|J„ T{g)) for any g e N^. This witnesses 
P <j /? as desired. □ 

Corollary 88. For every special set P c 2^, there exists a set Q Q 2^ such that Q <\ P and 

Q P- 

Proof By Theorem 83, we have P"P <} P =1,^ P. □ 

Definition 89. Fix a,p, y e {1, < a>, oj]. An (Qf,/?|'y)-degree a e !P^|^ has the strong anticupping property 
if there is a nonzero (a,/3|'y)-degree b e f^^^^ such that, for any (a,jS|y)-degree c, if a < b V c, then a < c. 

Corollary 90. Every nonzero a eP^^ has the strong anticupping property. 

Proof. Fix Pea. Let b be the (1, l)-degree of P~P. Then, by Theorem 83, for any (1, l)-degree c, if 
a < b V c, then a < c. □ 

Definition 91. For a IIj set P, we define the weakening of P as P^ = CPA~P, where recall that CPA 
denotes the set of all complete consistent extensions of Peano Arithmetic, and it is a (1, l)-complete 11° 
subset of 2^. 

By previous theorem, the weakening P' does not (1, l)-cup to P. In particular, we have P^ <j P. 

Remark. The specialness of P may represent that, intuitionistically, P is neither provable nor refutable, 
i.e., undecidable. Additionally, we can think of P ® 2 as representing the conjunction of P and Q 
(both intuitionistic and classical sense). Thus, the previous theorem expresses that, if an undecidable 
proposition P can be represented as a IIj subset of 2^, then P is not (intuitionistically) derivable from the 
conjunction P^ aP of the weakening P^ and any proposition R which does not derive P intuitionistically. 

Proposition 92. For any U^^ sets Pq, Pu Qo, Q\ £ 2^ ifPo <\ Q^andPi <\ Qi, then Pq" Pi <[ Qq'Qi. 
Hence, the operator V : !P{ — > !P{ introduced by (deg}(P))^ - deg}(P^) is well-defined. 

Proof. Assume that Pq <} Qq via a computable function <^q, and Pi <} Q\ via a computable function 
Oi. Then we can construct a computable function O* with (^*q{Tqq) Q Tp^ by modifying Oq as follows. 
For each cr e Pg^, if <l>o(o") extends a leaf p € Lp^, then we set <I>Q(cr) = p. If cr e Lg„, then let 0*(cr) 
be the leftmost leaf of Lp^ extending Oo(cr). Otherwise, we set <l>Q(cr) = <l>o(o")- Then, for each cr = p~T 
with p e and r € Pg,, we put Q>{cr) = <1)*(p)~<I)i(t). Clearly $ is computable, and Po~Pi <} 2o~2i 
via O. □ 

Recall that !P}(< r) = {a e P\ : a < 1^) is a principal prime ideal consisting of tree-immune-free 
Medvedev degrees [19]. Here, recall that a IIj set P c 2^ is tree-immune if P"' contains no infinite 
computable subtree. Then, we also observe the following. 

Proposition 93. Fix sets Po,Pi,Go, Gi £ 2*^, and assume that Pq^Pi <} Qo~Qi. Then, either 
Po ^{ Qo or P\ <} Q\ holds. Moreover, if Pq is tree-immune and Qq is nonempty, then P\ <} Q\. 
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Proof. Assume that Pq^Pi <} Qo Qi via a computable function <1). If <l)(p) € Tp^' for any leaf p £ Lq^, 

then 0(g) e [TpJ for any g e [Qo], i-e., Po <| Go- If 3>(p) ^ ^p^' for some leaf p e Lqq, then there 
are only finitely many strings of Tp^ extending 0(p). Thus, [Tp^^TpJ n [<l>(p)] is essentially a sum of 
finitely many Pfs, hence it is (1, l)-equivalent to Pi. Since a computable functional $ maps p~2i to 
the above class, obviously. Pi <} Qi. If Pq is tree-immune, then 0(p) ^ for some leaf p e Lq^, 
since otherwise the image of Tq^ under $ is included in Tp^, and clearly it is infinite and computable. 
Therefore, we must have Pi <[ 2i. □ 

Corollary 94, The weakening V : a i-^ a'^ /i' injective. Hence, V provides an order-preserving self- 
embedding of the (1, lydegrees P\ of nonempty 11° subsets of 2^. 

Proof. By Cenzer-Kihara-Weber-Wu [19], CPA is tree-immune. Therefore, by Proposition 93, CPA" 2 = 
gv <i pv ^ CPA-P implies Q <\ P. □ 

4.4. Infinitary Disjunctions along well-Founded Trees. 

Definition 95. The n-weakening P^"\ for each n £ N, is inductively defined as follows: P*-'^ - P, and 

p{n+l) _ p~ p(n) ^ 

Remark. One may think of P^"^ as the mass problem requiring to construct a solution to the original 
problem P with mind-change-bound or as the set of all oracles which tell us the information how we 
can construct an element of P with mind-change-bound n. On the sequent calculus of Limit Computable 
Mathematics, the number of times of the use of the weakening rule is related to the number of times of 
mind-changes (see Berardi-Yamagata [6] and Tatsuta-Berardi [71]). This is one of the reasons why we 
call P^"^ the n-weakening of P. 

Proposition 96. For any set P c 2^, there is a{\,n + \)-computable function F : p("+i) — > P. 

Proof. Each cr e 2^^ is represented to be of the form cr = po~p\~ ■ ■ ■ ~Pk~T for p, 6 Lp, i < k, and 
T e Tp. Then we consider cut(cr) = (po,pi, . . . ,p/t, t), and tail^"^(cr) = cut(cr; |cut(o") - 1|) = r. 
Moreover, tail'^^^Cg) is defined by limj tail'^"^(^ [ s) if it converges. Then, tail"^"^ is learnable via a 
learner *F who guesses an index of g i-> g^2,<icut(,T)-ii |cut(o-;OI ^ Then, clearly tail"^"^ : p("+') P. 
For any g e p("+'), the learning procedure of tail'^"^(g) changes at most n + I times. □ 

Proposition 97. For any set P c 2^^ and any set Q c N^, ;/ P <l ,^^ Q via a {\,n)-truth-table 
function, then P^"^ <} Q. 

Proof. Assume that : P^'^*^^ (8> 2 is (1, n)-truth-table computable via n many total computable functions 
0o> ■ ■ ■ > ©n-i- We define a computable function y : nx 2^^ — > 2*^^ as follows. If 0m(c) e Tp, then 
put y{m,o-) = 0„,(cr). If 0m(o") 2 p for some p e Lp, then we define y{m,cr) to be such p. Let 
z(cr) = minj/M < ?i : 0„,(c) G Pp}- Then, for cr e 2^^*, the value 0(cr) is defined by nm<z(a-) 7("J. o")- 
Then <D ensures that P'-"^ <\ Q. □ 

Corollary 98. For any it^ set P c 2^^ and any set R c N^, if a {l,n)-truth-table function : p("+'^®P ^ 
P exists, then a {\,n)-computable function S* . R ^ P also exists. 

Proof By applying Proposition 97 to 2 ^ p("+') ® P, we have P^"^ <j P^"^^^ ® P. So p(") <} R by 
Theorem 83, since p("+'> = p~p(")_ Since a (1, ?i)-computable function P*"^ ^ P exists by Proposition 
96, a (1, «)-computable function P — > P exists, as desired. □ 

Definition 99 (Transfinite Weakening). Let (O, <o) denote Kleene 's system of ordinal notations (see 
Rogers [57]). Then for each a eO we define the a-weakening P^"^ as follows. 

(1) p(0) = p. 

(2) lfa = 2^ then P^"^ = p-p^b\ 
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(3) lfa = 3- 5^ then P^"^ = P^{P^'^'^''^nehh 

Remark. The transfinite levels of mind-change hierarchy of A2 reals are well-known as the Ershov 
hierachy introduced in 1968 by Ershov (see Stephan-Yang-Yu [70]). The transfinite levels of mind- 
change hierarchy in machine learning has been introduced by Freivalds-Smith [32]. 

Proposition 100. For any 11^ set P c 2^ and any notation a eO, the a-th weakening P*^"^ is a 11° subset 

Proof. Fix a e O. By our definition, obviously P^"' is a subset of 2^*. We inductively assume that 
b <o a] is uniformly XIj. For a - 2^, we can easily compute a ITj index of P^"^ - P~P^''^ is from 
a rij index of P'^^'K For a = 3 • 5^, we can also easily compute a IIj index of P" = P~ {P^*^''^"^^ IneN from a 
computable sequence of H*' indices of {P^'^'''^"^^}„eN- Thus, jP^''^ : b <o a} is uniformly 11°. □ 

Definition 101. For each a e O, v/e let \a\o be the order-type of {b e O : b <o a]- The ordinal o)^'^ 
denotes the Church-Kleene cji, the first non-constructive ordinal, i.e., cJ^^ = supdab : a £ 0\. Recall 
that every computable ordinal is obtained from a computable well-founded tree. For each well-founded 
tree T c N*^-^, we inductively define Icrl^ : T — > cJ^^ by \o-\t = sup{|T|r : t e P & r 2 cr), where 
sup = 0. Then, the order type ofT is defined by o{T) = \{}\t- 

We may introduce the notion of mass problem with mind-change-bound a, by using a corresponding 
infinitary disjunction along a well-founded tree of order type a. However, an infinitaiy disjunction along 
a well-founded is, generally, not a subset of Cantor space 2*^. Meanwhile, each a-weakening is a subset of 
2^ as seen in Proposition 100. We now see that each a-weakening can be think of as a learning procedure 
with lalo-bounded-mind-changes, with precision ±1. 

Proposition 102. For any 11° set P c 2^ and any notation a e O, there are a well-founded tree Ta £ N^^ 

with o{Ta) - \a\o and a notation a' € O with \a'\o - \a\o + 1 such that P^" ^ <} Vve(r„ E(Ta)) -1 ^^"^ 
holds, where Py = P for each v e Ta- 

Proof. As in the usual argument, each notation a e O generates a computable well-founded tree Ta, by 
defining the tree-homomorphism ta : 0{<o a) — > N"^'^ as follows, where 0{<o a) = {b € O : b <o a]- 
Put taia) = {}. Fix b <q a, and assume that taib) has been already defined. In the case that b is successor, 
say b = 2'^ for c e O, we put ta{c) - ta{b)~0. If b is limit, say b - 3 ■ S"" for e e N such that Oe(?i) ie O, 
and <^e{n) <o ^e{n + 1) for each « € N, then we put ta{(^e{n)) = taib)~n for each n e N. Then we define 
Ta - Uaib) '■ b <o a]. It is easy to see that Ta is a computable well-founded tree, and o{Ta) - \a\o. Note 
that we have \t{b)\T^, - \b\o for each b <o a. 

We also define a computable function P : N — > N by recursion theorem. PutP(O) = 0, R{T) = 
and P(3 • 5") = 2^-5'*'' for each c,e en, where <^r(e){n) = P(Oe(?i)). Then, put a' = R{a). We claim that 
\a'\o < \a\o + 1- By transfinite induction, we show that \R{b)\() < \b\o + 1 for any b <o a. By definition, 
l^(0)b = |0b' t> <o a, and assume that \R{d)\o < \d\o + I is satisfied for any d <o b. For successor 
step b = 2', we have |P(2'^)|<5 = \2'^'-'-'''>\o = \Ric)\o + 1 < \c\o + 2 = \2'\o + 1. For Hmit step b = 3-5', 
|P(3-50b = |23-5'^'b+l = |3-5'-Wb + l = sup„,N(l^((l),(«))b) + l < sup„,N(l<l>.(«)b + l) + l = P-S^o + l, 
since {|Oe(«)b}MeN is strictly increasing. Thus, la'b < Mo + 1- 

For each ^ e Ta, the ^-root of Vve(r„ E(Ta)) ^ unique which is extendible in Vi.e(r„ e(TJ) ^'v 
with pr^(a") = (). Note that c p^ whenever ^ c ^. Then, = p^ ~write(^, Tp) is called the 
component of ^, where write(^, Pp) = {write(^, cr) : cr e Tp} (recall that write(^, o") = ® cr = 
((^, cr(0)), {(, cr(l)), . . . , (^, cr(|cr| - 1)))). Then, it is easy to see that U^ero is just the corresponding 
tree of Vve(7-<„£(7-„)) whenever ^i^^. 

We next assign some b e 0{<o a) U {-1} to each cr 6 T'-''^ where we use T'-"^ to denote the cor- 
responding tree of P'-"\ Every cr e 2*^^^^ can be represented to be of the form 7Tk(0)~7Tk(i)~ ■ ■ ■ ~^k(n)~T 
for some k{0),k{l), . . . ,k{n) e N, and some t e Tp. Here, n„ is the «-th leaf in Lp. Put cut(cr) = 
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{k(0), k(l), . . . , k(n)). We define the change-recording record„(c) e (p(<o a)) along cr of the mind- 
change-counter as follows. Put recorda(fr; 0) = a, and fix / < |cut(cr)|. Assume that recorda(cr; 0) is 
already defined. 

• If recordtXo"; /) < 0, then set rGCorda(cr; / + 1) = -1 

• If recordo(o"; /) is of the form 2^, then set recordQCcr; / + 1) = b. 

• If rGCordo(o"; /) is of the form 3 • 5'^, then set record^,(o"; / + 1) = Og(cut(cr; /)). 

Note that record is computable. Let us define ord(cr) e 0{<o a) to be recordaCcr; |recorda(o")| - 1). 
Then the relation g e P^"^ is characterized by the condition that ord(cr) > for any cr Q g. Define 
'^h'^ = {cr e r^"^ : ord(a") = b] for each b <o a. Then xj^'^ has a root at,, and indeed, xj^'-' = aifTp. Note 
that ta is the computable tree-isomorphism between 0{<o a) and Ta, and {T^j^'']b<oa is also uniformly 
computable. Then, the set of all infinite paths of the computable tree Ui<oo -^/l"^ coincides with P'-''^ 

We first show that "^JyeiT,, e{t„))^v ^} P'^"^- We consider a computable mapping F : o-^, i-^ Pt„ib)- 
For each ah~o- e T^"\ we define r{ah~o-) = <l)(afo)~write(fa(Z7), cr). Clearly, F(cr) e Ct^(b) for each 
cr e T'j"^ Thus, Vve(r„ E(Ta)) -1 ^''"^ ^- construct a computable function A witnessing <} 
Vve{T„ E(Ta))^^'- ^iP()) - '^(0) - ()■ Fix^ ( ^ Ta- Inductively assume that A(pp is already defined. 
Note that is a leaf of . Then A(pp is of the form cr~T, where t is the tail of A(pp. By uniformly 
partial computable way, we can extend the tail t to leaf(T) e Lp. If has just one successor in Ta, 
i.e., ^ 1 ^ Ta, then we set A(pf) = cr~leaf(T) 2 A(pp. If has infinitely many successors in 
Ta, i.e., ^ 1 e Ta, then we set A(p^) = cr~leaf(T)"7r^(|^|_i) 2 A(p~). For each p^~y e Q, we set 
^(P^ y) = A(pf )~y. Put R{() = ta{R{b)) for each ( e T, where b € O is the unique notation satisfying 
ta{b) = ^. Then, A(cr) e T^^^^ for each cr e Q. Consequently, P^"'^ <\ Vve(r,£(r)) A- via A. □ 

Proposition 103. For any special ITj P c 2^, /fa, e O and a <o b, then P*^^^ does not (1, \)-cup to 
P^"\ i.e., for any set R c j/P^^^ <} P^*^ ® P f/jen P^"^ <} P. 

Proof. The assumption a <o b implies 2" <(9 b. Therefore, we have P"') <} P(2"). By Theorem 83, P^^"'^ 
does not (1, l)-cup to P'^"\ Thus, P^''^ does not (1, l)-cup to P^"K □ 

Fix any notation omega e O such that |Oomega(i)b = ^ for each n e N. Note that lomegal,^ = co. 

Proposition 104. Let P be a special 11° subset o/2^, and a e O be any notation. For any set R c N^, if 

P^"^ ^tt,<u p(" o™^9='> ®P, then P(") P. 

Proof By the definition of </, <^, if P^"^ </, <^ p(a oomeQ^) ^ ^^^^ ^^^^^ ^ (l,n)-truth-table function 
r : p^' oomega) ^ ^ _^ p(a) f^^. ^^j^jg ^ e N. In particular, F : (p„+rp(" oi'''-'-9='<"+i») ® P ^ P^"), where 
p„+i is the {n + l)-th leaf of Tp. By modifying F, we can easily construct a (l,n)-truth-table function 
. p(«o<tomega(«+i)) ® ^ p("). By Corollary 98, we get a (l,n)-computable function 0* : P ^ p("). 
Thus, P("^ P. □ 

Let T be a learner. We say that c : N^^ ^ (9 is a mind-change counter for *F if, for any cr e N^^, 
c(o") <(9 c(cr") whenever ^(cr) ?!: 4'(cr"). A learner Y is a-bounded if there is a computable mind-change 
counter c : ^ O for ^ such that |c«»b < a. 

Proposition 105. Let P be aU^^ subset of 2^, and let a € O be any notation. Then P <^ P^"^ via some 
\a\o-bounded learner 

Proof. Recall the definition of recorda : 2^^ ^ ((9 U {-1})^^ in the proof of Proposition 100. For 
g € P^"\ by counting record^,(§)> we can easily see that g i-> tail'^"^(g) is (1, tL»)-computable via an 
|a|(9-bounded learner. Here the partial function tail*^"^ : is defined as in Proposition 96. □ 
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Corollary 106. For every a eO there exists a computable function g such that, for any ITj index e, ifPe 
is special then the following properties hold. 

(1) Pg(e,b) <\ Pg(e,c) holds for every c <o b <o a, indeed, Pg{e,b) does not (1, \)-cup to Pg{e,cy 

(2) Pg(^e,b) =1 Pg{e,c)for every b, c <o a. 

Proof. Let g{e, b) be an index of P^g \ Then, the desired conditions follow from Proposition 103. □ 

For any reducibility notion r, and any ordered set (/, </), an /-indexed sequence {a,),g/ of r-degrees is 
r-noncupping if, for any / </ j, the condition a, b must be satisfied whenever a, <r aj V b, for any 
r-degree b. In particular, any r-noncupping sequence is strictly decreasing, in the sense of r-degrees. 

Corollary 107. For any nonzero (l,a>)-degree a e f^, there is a (1, \)-noncupping sequence of{\, 1)- 
degrees inside a of length (xf^ . (Of course, such a sequence is not computable). 

Proof. Fix a n'j' set Pea. Pick a path p Q O through O of order type oj^^ . Then, {P''"^}aep is a desired 
sequence by Proposition 103. □ 

4.5. Infinitary Disjunctions along the Straight Line. We introduce the LCM disjunctions of {P;),gN as 
VnenPn ^ UneN(^oV . . . vP„) and SJ^^qP,, ^ UneniPo' ■ ■ ■ ~Pn)- This is a straightforward infinitary 
iteration of the commutative and noncommutative concatenations. \f P^ - P for all n € N, we write V P 
for P„ - Pn. In this case, to simplify our argument, we again think of V as the non-commutative 
disjunction ~. 

Remark. In the context of Computability Logic [39], Japaridze [40] have introduced the sequential 
existential quantifier SJ nA{n) and the sequential corecurrence \/ A. We fix some interpretation |[-| : 
Snt — > !P(N^), where Snt is the set of all sentences of a fixed language in Computability Logic. Then, 
our disjunction operations SJ^^A{n)J and V|[AJ coincide with the existential quantifier y nA{n) and the 
corecurrence SJ A, respectively. 

Proposition 108. Let {P„]nei^ be a computable collection ofll^ subsets ofBaire space N*^. 

(1) ®nPn =o.VnPn- 

(2) vr Pn =} S/ve(tis)Pv' where S is the successor relation. 

[V- ]<„,„) Pn.,n <\ Pn,m <\ [V. ]„ Pn <\ V„ Pn, where Pn,,n = Pnfor each m € N. 

Proof (1) Clearly [V^j]„ ^1 V„^«> and by Proposition 66. (2) For each cr e (N x N)<^, we 
calculate count(a") = max{m : pr,„(o-) {)]. Then SJ'^ P^ <{ Vve(NS)^v is witnessed by cr i-^ 
n;<count(a-) PJ^Kc)> where recall that the concatenation is denoted by H- Each cr e can be represented 
as cr = Po~p\~ . . . ~Pn~T, where p„j e Lp„, for any m < n, and r e Tp^^^^. Then, we define cut(cr) = 
(po,pi, . . . ,Pn, t). Then 0(cr) = n,<|cut(o-)| write(/, cut(cr; /)) witnesses V nPn >\ Vve(N,5) ^v- 

(3) We only show SJ(n,n)Pn,m [Vtj] Pii' since other relations are trivial. Each cr e can be 
represented as cr = po~pi~ . . . ~ Pu~T with p,, G /-p,,,,^, for any v < u, and r e Tp^^^,,^, where we think 
of each i< e N as a pair ((m)o, Then we write wi(cr) - u, and put L{cr) = po~pi" . . . ~p„"leaf(T), 

where leaf(T) is the least leaf of rp(„+,)p extending r. Fix cr = t~((/, m), (j, n)) e (N x N)*^-^. Assume that 
0(t~((/, m))) is already defined. If / = j, then we set <l>(cr) = <I)(t~((/, m))Y{n). If / 1 j, then we calculate 
the leasts 6 N such that (7, A:) > m((D(T"((/, m)))). For such A:, put /(T = (7,A:)-m(<D(T~<(/,m)»)- 1. Then 
we define <^{cr) - L(<I)(t~((/, m))))~L((»^~prj(cr). Here L{{))^ denotes the concatenation of K many 

L(())'s. It is not difficult to see that V<,„„> Pn.m <\ [V^ ]„ Pn via O. □ 

Proposition 109. Let {P, };eN be a computable collection of nonempty IIj subsets of 2^. Then \7^, f „ is 
(1, l)-equivalent to a dense l.^ set in Cantor space 2^. 
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Proof. Let S denote the set {g e (N U {ft})^ : {3n € N) (count(g) = n &. tail(g) e P„)}, where 
count(g) = #{n € N : g{n) = H). Then, S is cleai'ly a 1° subset of {0, 1, jl)^. For any cr e {0, 1, we 
have cr~(Jj>~/j 6 5 for any h e Pcount(o-)+i Thus, S intersects with any clopen set. □ 

Example 110. Let MLR denote the set of all Martin-Lof random reals. Then MLR =} P for any 
nonempty set P c MLR, by Kucera-Gacs Theorem, while MLR <} P for any 11° set P c MLR as 
follows. 

Proposition 111 (Lewis-Shore-Sorbi [48]). No somewhere dense set in Baire space (1, \)-cup to a closed 
set in Baire space. In other words, for any somewhere dense set D c N^, any closed set C c M^, and 
any set RQW\ifC <\D®R then C <\R. □ 

Proposition 112. For any somewhere dense set D c and any special closed set C c N^, we have 
C D. 

Proof. If {Diji^h is a finite partition of D, then |J,<^ C1nn(D;) = CIj^n(D), where the topological closure 
of D, in the standard Baire topology on N^, is denoted by CIi^n(D). To show this claim, for every 
X e C1nn(D) we have a sequence {x^ j/tgN c D converging to x. By pigeonhole principle, there is i < b 
such that there are infinitely many k such that x^ e D,-. For such /, cleai^ly x e C1|^n(D;). However, since 
the somewhere density of D implies that CIjjn(D) contains some clopen set, and hence C1jjn(D,) contains 
a computable element r for some /. Additionally, CIi^n(C) = C since C is closed. If C <^'^ D ® /?, then 
there is a finite partition {D,},<fo of D such that C <} D, via a computable function (^e{i)- Fix / such that 
C1j^n(D,) contains a computable element. Therefore, C - CIjjn(C) <j C1j^n(D,) 3 {r} via *5f(jy Hence, C 
contains a computable element. □ 

Especially, if P is a special n° set, then there is no nonzero (< o), l)-degree of n° subsets of 2^ below 
the (< oj, l)-degree of V P- We will see that the set V P has a stronger property. 

Definition 113. A sequence <f„)„eN of finite strings is a timekeeper if there is a uniformly c.e. collection 
of finite sets, {y„}„gN> such that, for any n € N, |?„| = |V„| and f„(/) is given as the stage at which the i-th 
element is enumerated into y„, for each i <\tn\. 

Definition 114. For a finite string t e N*^^, the r-delayed (|t| + l)-weakening P^^^ is inductively defined 
as follows: 

p(rro) ^ p. p{TU+i) ^ \J{cr'P : o- e Lpim & \cr\ > r(/)} for each / < |t|. 

Proposition 115. //T(m) = for each m < \t\, then P^^^ = pd^l+i). 

Proof. Straightforward from the definition. □ 

Lemma 116. For any timekeeper {tn)nen, the following conditions hold. 

(1) pC") c p(l'"l+i). Hence, 0,7^ P^'"^ c V^- 

(2) P('") is U^^, uniformly in n. Hence, P^'"^ is n°. 

Proof. (1) Straightforward. (2) We construct a computable tree P^'"^ corresponding to P^'"\ Each o" e 2^ 

can be represented as o" = po~Pi~ ■ ■ ■ ~Pk~T, where p,„ € Lp for any m < k, and {} i= t e Tp. Then 

o" e r^'"^ if and only if ?„(^) holds by stage |po~Pi~ ■ ■ • Pkl Then T'-'"^ is a computable tree, and clearly 
p(t„) ^ [j(r„)]_ □ 

Remark. Our finite injury priority argument often yields a timekeeper. Therefore, the delayed weak- 
ening construction is useful, since the recursive meet 0^ pd'/J+i) of the standard weakenings along a 

timekeeper {tn}neN is only assured to be H^'® . 

Tiieorem 117. Let P be any n° subset ofl^i Then, for every special set Q c 2^, there exists a Hj 
setPc\JP such that Q P. 
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Proof. Let 2 be a special 11^ set, and P be a given 11^ set. By a uniformly computable procedure, from 
P, we will construct a timekeeper {f„}„gN- The desired class P will be given hy P - ®,7^ P^'"\ 

Requirements. We need to ensure, for all n e N, the following: 

Rn ■■ e<LPvia?i ^ (3A„)A„€e. 

Action of an /?„-strategy. Fix an effective enumeration {p„ : « G N} of all leaves of Tp. An /?„-strategy 
uses nodes extending the «-th leaf p„ of Tp, and it constructs a finite sequence a sequence t„[5] 
of strings, and a computable functional A„. For any n, put ?„[0] = (), and t„[0] = pn at stage 0. An 
R„-strategy acts at stage i' + 1 if the following condition holds: 

(3p € < n) (t>eiTn[srp) e Tq & 0,(t„[5]» 2 0,(t„[5]). 

If an /?„-strategy acts at stage s + I then, for a witness p e Tp, we pick p* e Lp extending p. Then let 
us define t„[5 + 1] = T„[5]~p*, + 1] = tn[s]~{\Tn[s + 1]|), and A^,, T ' = [■^ + 1]), where / 
is the length of <I)e(T„[5 + 1]). Otherwise, t„[s + 1] = t„[s], Ti[s + 1] = Ti[s]. Note that the mapping 
(n,m) i-> Tn(m) is partial computable. At the end of the construction, set = lJi ^«['*]- As mentioned 
above, P is defined hy P - P'''"^- 

Claim. An 7?„-strategy acts at most finitely often for each n. 

Clearly t„ = IJ^. t„[5] is a computable string. If R„ acts infinitely often, then Ag „ = Og(T„) e Q 
for some e < n hy our choice of t„. Since Og(T„) is computable, Q contains a computable element. 
However, this contradicts our assumption that Q is special. Therefore, we concludes the claim. As a 
corollary, (f„)„eN is a timekeeper. 

Claim. P P. 

Let T„ - T„[5']. By induction we show that t„ 6 pn~Tp^^ly First we have the following observation: 

'nl^J — P« t p,i Ip — Pn ^ p{i„\0) ^ Pn ^p(r„[Oj)- 

Assume t„[s] £ p,rr^^|,[,,j,. If t„[5 + 1] - T„[5]-p* for p* e Lp then + 1] - ?„[5]"<|t„[5 + 1]|>. 
In particular t„[5 + 1] e p„~ Lp(i„u+i]nt„im and |t„[5 + 1]| > t„[s + l](|f„[5]|). Hence, by the definition of 
p(t„U+i])^ it is easy to see that t„[s + 1]"P c p„-p('"[*+i]). Thus, t„[s + 1] e Pn~T'pl!„i,»i-iy So we obtain 
T„ e p„~r^-^^'j and by our construction of t„ there is no p e P and e < n such that Oe(T„~p) 2 O^X^n)- 
Since Og(T„) is a finite string, for any g e p„~r|,[,'^ c P extending t„, <l>e(g) is also a finite string. 
Consequently, this g witnesses that P P. □ 

Corollary 118. (1) For every special U^^ set P c 2^ we have V P <^'^ P =i V ^■ 

(2) For every special n° ^e? P c 2^ f/iere exists a H^ ^ef g c 2^ with Q <<'^ P =^ Q. 

Proof. By applying Theorem 117 to 2 ^ P, we have P P >i.^ V^- Moreover, P © P <<'^ P =^ 
P®P. □ 

4.6. Infinitary Disjunctions along ill-Founded Trees. To establish the nonexistence theorem on (1, oS)- 
contiguous {< OD, (jj)-degrees, the team-learning proof model of P is expected to be useful. We can directly 
introduce the proof model ofP by a team ofn learners as [V^ ] -^^^ V ^• 

Proposition 119. P =<'^ [Voo ],<„ V P for any PqB^ andne N. 

Proof. Each cr e N^^ is represented as o" = po'pi" . . . "Pn~T, where p; e Lp for each / < n and r £ Tp. 
Then we put tail'^"^(o") - t. Let be a learner who guesses an index of tail'^^^CprjCcr)) for each 
cr € N"^^, where note that tail^"^ o pr,- is learnable, since pr,- is partially computable and tail'^"^ is 
leamable. For any g e [Voo ];<„ V ^> obviously tail""^(pr,(g)) £ P. Thus, P =<'^ [Voc ],<„ V P via the 
team {*F},<„. □ 
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However, this model may be far from 11° whenever P is 11°. To break out of the dilemma, the following 
minor modification of consistent dynamic disjunction is helpful. For any tree Tp c N"^^ and / € N, we 
let Tp~{i) denote the tree Tp U [JpeLpP~(i)^ Tp~Tq denote the tree Tp U UpeLpP~TQ- Iri other words, 
Tp~Tq is a corresponding tree of P~Q. 

Definition 120. Let V be a subtree of N<^, {Pa-]o-ev be a computable sequence of n° subsets of 2^, and 
To- £ 2^^ be the corresponding tree of Pa- for each cr e V. Then the concatenation o/{Po-}a-ev along the 
tree V is defined as follows. 

TeV\i<\T\ , 

Proposition 121. Let V he a computable subtree ofT^^^, and {PcAa-ev he a computable sequence o/n^ 
subsets of2^''\ Then ^a-evPo- is TIj subset of 2^. Moreover, ^a-evPa- is (l^ l)-equivalent to ^ a-e{v,E(V}}Po- 
in the sense of Definition 79. 

Proof. To simplify our proof, we assume that T^- is the full binary tree 2^^ for each cr ^ V. Each 
a e 2<N is represented as a = po'{T{0))-pr{Til)y . . .-(t(\t\ - 2))-p|^|_r <t(|t| - l))"^ e 2^^, 
where t e 2*^^, p{i) e Ttii for each / < |t|, and /3 e Tt. For such t and (3, we set walk(Qr) = 
T, and cut(a) = {po,pi, . . . ,p\r\~i,/3). We also define tail'^"^(a) - cut(a; |walk(Q')|) - p. Note 
that walk, cut, and tail*^"^ are total computable on N"^^. Then the set ^a-evPa- is chai^acterized 
as the set of all paths of the computable tree {a e 2"^^ : walk{a) e V & tail'^"^(Q') e Tp^^^^^^,!. 
Therefore, it is 11°. As we mentioned before, we now note that each a e 2^^^ is represented by 
(ni<|waik(Q')| ^ut(Q'; /)~(walk(a; ~cut(Q'; Iwalk(Q')l). Then, by defining (^{a) for each a e 2"^^ to 
be the set n!<|waik(a)| write(walk(Q') \ i, cut(a; /)), the function O witnesses To-evPa- ^} ▼o-e(y,£(V))^o-- 
Conversely, to see ^a-evPo- ^} ^ a-e{v,EiV))Po-, we inductively define a computable function H. Set 
0(0). Fix a = a ^{{cr,m),{T,n)} € {V X 2)"^^, and assume that ^{a~) has been already defined. If 
o" = T, then set H(a) = E{a~)~{n). If o- t, say t = cr^{i}, then we first calculate the least leaf 
leaf(E(fl'")) of Tp^ extending H(a"). Then we set E{a) = leaf(H(a~)~(/, n). Note that, for each 
a = a—{{T,n)) e (V x2)<n, we have walkCHCa)) - (a{\a\ - l))o = t, and tail'^^^CHCa)) - pr„aik(„)(Qr). 
Thus, H witnesses Wo-evPa- <\ ▼o-e(V,£(V))^o-- □ 

Proposition 122. Assume that V is a computable subtree o/N"^-^ and {Po-jo-ev is a computable collection 
o/n" subsets ofn^. Then f^evPcr =T [V] © Pa- 

Proof. Let If(cr) be the least leaf of Tp^. Then 1£ : V ^ is computable, by uniform computability 
of Lp^. Fix fern® 0^,i,<nP^. If / - 0-^, then put 0(/) - n„eN(lf(g \ If / = 

{l,o-)~g, then 0(/) = (nn<|o-| lf(o" \ n)~{o-{n))^~g. We again use the notions walk and tail*^"^ in 
the proof of Proposition 121 In the case / = 0~g, we have g e [V]. Therefore, walk((l)(/)) e [V]. 
Hence, 0(/) e ^a-evPa- If / = (Lcr)~g, then we have g e Pa-. Therefore, tail'^^^COC/)) exists, and 
tail^"^(0(/)) e Pa-, where tail'="^(/j) - hm„gNtail(/j [ n). Thus, To-eyPo- <| [^] © g-g|^<N Per V1<1 

o. 

We consider two learners *Fo who guesses an index of 0~walk(Q') on ck e N^^, and 'I'l who guesses 
an index of (1, walk(a))~tail'^"^(Q') on a e N"^^. Note that walk : / i-^ hm„walk(/ \ n) is partial 
computable, and tail™^ is learnable. For each / e Wa-evPa-, if walk(/) is partial, then walk(/) € 
V, and tail'^"^(/) e -PwaikC/)- Thus, the learner succeeds to guess a con^ect index of a solution 
(1, walk(/))-^tail'^"^(/) to [V] ® ©^gjj<N Pa- on /. If walk(/) is total, then walk(/) e [V]. Therefore, 
the learner succeeds to guess a correct index of a solution 0~walk(/) to [V] ® 0o-eN^**^o" f- 
Consequently, W^evP<T >T [^1 ® ©^eN<N ^'r- ° 

Definition 123. For Hj sets P,Q Q 2}^, the hyperconcatenation of P and Q is defined by QfP = 
^o-eYgPa-, where Tq denotes the corresponding tree for Q, and Pa- = P for any cr e Tq. 
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Proposition 124. QVco V ^ ^} Q'^P A Q'^P AQ® ^f^^ '^^y n? sets P,QQ N^. 
Proof. We first construct a computable function O witnessing QVoo ^1 Q^P- Each o- e N^*^ is 
represented as (®,<|„aik(Qr)| cutCo-; /)~<walk(Q'; /)>) ~tail'^"^(Qf), where c\xX.{a;i) e Lp for each / < |t|, 
walk(a) e N<^, and tail'^^^Co') e Tp. Then we define O as follows. 



'write(l,tail^"^(a)). 



(D(a) ^ PI write(l,cut(a;0)~((0,walk(a;0)) 

j'<|walk(Q-)| 

Note that pro(0(a)) = walk(a) and pri(0(Q')) = (ni<|r|Pr) "tail(a). Therefore, for any g e QfP, 
if walk(^) is total, then pro(0(g)) = walk(^) e Q. If walk(g) is partial, then tail'^"^(g) is total, and 
pri(<l)(g)) is of the form po~ . . . ~p„~tail(^), where p, e Lp for each / < n. Thus, pri(0(^)) e SJ P, 
since tail'^^^Cg) e P. Hence, Q^ooSJ P <\ Q^P- 

We next show QjP <} Qv/". Fix a leaf p e Lp. Each cr e N'^, if o" extends a leaf t e Lg, say cr = T~r], 

then we set 0((r) = (n,<|r|P~<^(0>) "y/- If e Tg, then set 0{(r) - (n,<M P"((^(0>)- Fix / e QvP. 
Then / e 2 or / - t"^ for some t e Lq and ^ e P. If / e 2, then walk(0(/)) - / e If / is of the 
form / - T'g, then tail'^^^COC/)) = g e P. Hence, 0(/) € QjP. □ 

Remark. The relation QVco SJ P <\ Q'^P in Proposition 124 indicates that the hyperconcatenation QfP 
can be viewed as a special case of team-learning proof model of Qv P, because V Q^oo \J P is a. proof 
model of 2 V P by a team of two learners. Later, we will see that QfP is also related to 22"'-EM, the law 
of excluded middle for formulas. See Theorem 161 and 181. 

Corollary 125. [Voo ],-<2 SI P A P^Pfor any H^ set P c N^. 

Proof Because PVco SI P Q [Voo ],<2 V P and by Proposition 124. □ 

The next theorem concerning the hyperconcatenation T and the (1, a»)-reducibility <^ is a counterpart 
of Theorem 83 concerning the concatenation V and the (1, l)-reducibility <}. 

Theorem 126. For every special n° sets P,Q Q 2^, and for any R, if P <l {QfP) ® R then P <l R 
holds. 

Proof. Let Tj denote the corresponding computable tree for QfP. The heart ofTy, T^, is the set of 
all strings y e Ty such that y c n(<n(o"r(T"(0)) for some {cr,j,<„ c Lp, and t e Tq'- Now we assume 
P ^i, iQfP)®R via a learner To show the theorem it is needed to construct a new learner A witnessing 
P <l R. Fix g eR. 

Lemma 127. There exists a string p e T^ such that, for every t e T^ extending p, we have ^(p © (g [ 
IpD) = 'i'{7)for any y with p(Big t |p|) QyCr^ig I |r|). 

Proof. If Lemma 127 is false, we can inductively define an increasing sequence {T,},g(j of strings. First 
let To = 0, and t,+i be the least t d t,- such that t e T^ and *P(t ® (g t (|t| + /))) * 'i'ip © ig I (Ipl + 7'))) 
for some i,j < 2. Since \JiTj e QfP, clearly (UiTi) ® g e (QfP) ® /?. However, based on the 
observation (|J,- t,) © g, the learner ^ changes his mind infinitely often. This means that his prediction 
lim„ *F((|J,- Tj) © g) diverges. This contradicts our assumption that P <^ (QfP) ® R via the learner *F. 
Thus, our claim is verified. □ 

Lemma 127 can be seen as an analogy of an observation of Blum-Blum [9] in the theory of inductive 
inference for total computable functions on N. Such p is sometimes called a locking sequence. 

Lemma 128. There exist an effective procedure : x 2'^-^ x 2 ^ and a H^ condition ip such that, 
for any g ^ Q, ip{g, p, m) holds for some p e 2^^, and m < 2, and that for any p e 2^^ and m e N, if 
(p{g,p,m) holds, then &{g,p,m) e P. 
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Proof. The desired condition (fi{g,p, m) is given by the conjunction of the following three conditions. 

(1) p is of the form \~^i<„icri~{T{i)}) for some {o",},<„ c Lp, t £ and |t| - n. 

(2) T~(m> e r-'. 

(3) 'P(p e (g r IpD) = 'P(r) for any y e (p-^Tp- {mYTp) ® {g}. 

The first two conditions are clearly IIj, and since ^ is total computable, the last condition is also 
IIj. Consequently, tp is IIj. We first show that ip{g,p,m) holds for some p e 2^^ and m e N. Pick a 
locking sequence p e forcing to stop changing the mind of ^, as in the previous claim. Without loss 
of generality, we can assume that p satisfies the condition (1). Since t e Tq', there exists m e to such 
that T~{m) e Tq' , and this m satisfies the condition (2). From conditions (1) and (2), we conclude that 
p~P~{m)~ P - (fi'P) U {p~ UireLp o-~{m)~P) c r^, and so condition (3) is satisfied. Since we assume 
that P <Ij (QjP) ® [g] via the learner 4^, if ipig,p, ni) is satisfied, then the following holds. 

P <\ (p'P'imyP) ® {g] via ^Tferwep)- 

Our proof process in Theorem 83 is effective with respect to g, m, and an index of Ovj/(g ripi^p) which 
are calculated from g, p, and an index of ^. To see this, recall our proof in Theorem 83. Define Vp = 
Tp U {p~(m) : p 6 Lp}. 

^0 -Vp®igu - (Pvy(^npifflp)(^o 

^,-+1 -{Vp L>i )®\g\, -^^(g\\p\®p)KE.^^ ). 

Then, as in the proof of Theorem 83, D^''^'"' - UieN D^jf{"^ is a subtree of Vp, and it has no dead ends. 
Moreover, this construction is clearly c.e. uniformly in g, p, and m. Therefore, we can effectively choose 
an element @{g,p, m) e [D^'-'^''"] c P, uniformly in g. p, and m. □ 

Now, a procedure to get P <^ 7? is follows. For given ^ e 2, on the i-th challenge of a learner A, 
the learner A chooses the lexicographically i-th least pair (p, m) e 2^*^ x N, and A calculates an index 
e{p, m) of the computable functional g &ig,p, m), that is to say, A(^ \ s) = e(p, m) at the current stage 
s. At each stage in the i-th challenge, the learner A tests whether the n'j' condition ip{g, p, m) is refuted. 
When ipig,p, m) is refuted, A changes his mind, and goes to the (/ + l)-th challenge. Clearly lim^ A(^ \ s) 
converges, and Oum, a(^. r*)(^) ^ P holds. □ 

Corollary 129. For every special IT',' set P c 2^ there exists a fl^ set 2 c 2^ with Q <l P = Q. 

Proof. By Theorem 126, if P <^ (PtP) (8)2^=} PtP, then P <^ 2^, i.e., P contains a computable 
element. As P is special, we must have P PtP. By Proposition 122, P <^ PfP. Therefore, for 
Q = PjP, we have Q <l P =<- Q. □ 

Corollary 130. Every nonzero a e Pj^ has the strong anticupping property. 

Proof. Fix Pea. Let b be the (1, a>)-degree of PtP. Then, by Theorem 126, for any (1, a>)-degree c, if 
a < b V c, then a < c. □ 

The primary motivation of the second author behind introducing the notions of learnability reduc- 
tion was to attack an open problem on subsets of 2^^. The problem (see Simpson [61]) is whether 
the Muchnik degrees {{a>, l)-degrees) of n° classes are dense. Cenzer-Hinman [20] showed that the 
Medvedev degrees ((1, l)-degrees) of n'j' classes are dense. One can easily apply their priority construc- 
tion to prove densities of (1,< a»)-degrees and (< a>, l)-degrees. The reason is that the arithmetical 
complexity of A* - {{i,j) e : P; <^ Pj] is for ia,/3) e {(1, !),(!,< w),(< oj, 1)}, where {P<,}eeN 
is an effective enumeration of all 11^ subsets of 2^. It enables us to use priority argument directly. How- 
ever, for other reductions (a,/3), the complexity of A'^ seems to be 11} . This observation hinders us from 
using priority arguments. Hence it seems to be a hard task to prove densities of such (a,y6)-degrees. 
Nevertheless, our disjunctive notions turn out to be useful to obtain some partial results. 
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Theorem 131 (Weak Density). For nonempty n\ sets P,Q Q 2^, if P <l Q and P <^'^ Q then there 
exists a 11° set R c 2^^ such that P <l R <l Q. 

Proof. Assume P <l Q and P <<'^ Q. Let R ^ {QjQ) ® P. Then P <l R <l Q. Moreover Q P 
implies Q R = (QfQ) ® P, by non-cupping property of T. On the other hand, 7? = (QjQ) ®PiljP 
since Q^Q =1^ Q P. Consequently, P <l R = (QyQ) ® P <l Q. □ 

4.7. Infinitary Disjunctions along Nested ill-Founded Trees. By using the previous method, we can 
obtain a finer observation. We introduce two totality restrictions for learners. 

Definition 132. Let ^ be a learner. 

(1) ^ is confident if lim^ *P(/ \ s) converges for every / E N^. 

(2) ^ is eventually -Popperian if, for every / e N^, ^\im,^{j\s){f) is total whenever limj^(/ \ s) 
converges. 

(3) ^ is eventually-Lipschitz if there is a constant c e N such that, for every / e N^, l^&iimj t 
I + c)\ > / for any / e N, whenever lim^ ^(/ I s) converges. 

Proposition 133. 

(1) For any set X,Y c N^, ifX <^'^ Y, then X Y via a team of eventually -Popperian learners. 

(2) For any set 5 c 2^ and any set R c N^, ifR <^ S, then it can be witnessed by an eventually- 
Popperian learner. Moreover, if S is ITj, then it can be witnessed by a confident eventually- 
Popperian learner. 

(3) For any n° set P Ql^^ and any set Q c N^, if P <1'^ Q then P <<'^ Qby a team of confident 
learners. 

Proof. (1) Straightforward from the definition. 

(2) Fix a computable increasing sequence {r,},g^ of infinite computable trees such that 5 = U([^(]- 
By padding, there is a computable function p : ^ N such that ^p{e,n) corresponds exactly to O^, and 
p{e, n + \) > p(e, n) for any index e and n. Assume that R <lj S via a learner We need to construct a 
eventually-Popperian learner A witnessing R S . At each stage s, we define a value of A(cr) for each 
o" e 2*. For a given cr € V , we compute q{cr) = min({/ < s : (Vr e 2*) r 2 cr t e T;) U {s}), and put 
A(cr) = p(*P(cr), q{cr)). If f ^ S , then lim„ q{f I n) diverges. Therefore, lim„ A(/ |~ n) diverges. On the 
other hand, if / € 5, then hm„ q{f \ n) converges to some q. Then %m„ A(/r«)(/) = ^p(Xim„^(f\n),q)'^f) = 
^iim„'F(/r«)(/) £ P- Consequently, A is eventually-Popperian, and witnesses 7? <^ 5 . If 5 is Hj, then we 
modify A by setting A(cr) to be a fixed index of a total computable function g 0^, whenever cr extends 
a leaf of Ts . Then, A is also confident. 

(3) If P Q via n many computable functions {<!>,•},<„, then each learner for each / < n guesses 
an index of O;. Note that does not change his mind. In particular, is confident. □ 

Proposition 134. Let V be a computable subtree o/N^^, and {Po-lo-ev be a computable collection o/IIj 
subsets ofn^. Then [V] ® 0^gp,<N 

Per —0)^ ^ crevPcr by a team of a confident learner and an eventually- 
Popperian learner. Moreover, ifP and Q are 11^ subsets of 2^, then Q®P <^ Q^m V P ^ team of a 
confident learner and an eventually-Popperian learner 

Proof. As in the proof of Proposition 122, we consider two learners: a learner who guesses an in- 
dex of Q' i-> 0"walk(Q'), and a learner *Fi who guesses an index of o- i-> (1, walk(a))~tail'^"^(Q'). 
As / i-> 0~walk(/) is partial computable, does not change his mind. In particular, is con- 
fident. On / € M^, the learner changes his mind whenever walk(/ \ n + I) properly extends 
walk(/ \ n). If lim„grj*Pi(/ \ n) converges, then walk(/) must be partial. Thus, tail'^'^^(/) must 
be total. Then, (1, walk(/))~tail'^"^(/) is total. Therefore, is eventually-Popperian. Moreover, 
Q®P Q^co V P vi^ ^ team of two learners, {Y,),<2, where guesses cr i-^ pro(o"), and guesses 
o" i-> tail'^"^(pri(o")). As in the previous argument, we can easily see that is confident and is 
eventually-Popperian. □ 
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Proposition 135. Let Pq, P[, Qq, Q\ be IT" subsets of 2 such that Qq <^ Q[ via an eventually Lipschitz 
learner and that Pq <} Pi. Then, Qq^Pq <^ Q\^P\- 

Proof. For any partial computable function O, without loss of generality, we may assume |<1>((t)| < 
|0(o-")| + 1 for any string cr e N^^. For given indices / and j, we effectively construct a computable 
function <l>hyp(ij) as follows. Put (l>hyp(ij)(()) - 0, and assume that <5hyp(/,y)(o"^) has been already defined. 
Note that, either |walk(cr)| = |walk;(cr")| + 1 or |tail'="^(cr)| = |tail'="^(cr')| + 1 is satisfied. Here, the 
notation tail*^"^ is used in referring to decomposing Q\yP\. If the former is the case (i.e., |walk(o")| = 
|walk;(cr")| + 1), then we extend tail'^"^(Ohyp(,-;)(cr")) to leaf o tail'^"^((l)hyp(i,y)(o'")), the least leaf 
of Tpi, extending it, and then, concatenate the bit <l),(walk;(cr); |walk(cr)| - c) to it. Formally, for a string 
T e N'^^ with Ohyp(;,;)(cr") = T''tail'^"^(Ohyp(,-,j)(cr~)), we define 

%yp(/j)((^) = T-leaf o tail'^"^(Ohyp(,j)((T-))~((D,(walk(tr); |walk((r)| - c)). 

Here, we fix some string p e of length c, and we set <l>;(o"; k - c) - cr(k) for each k < c. If 
(I),(walk(cr); |walk(cr)| - c) is undefined, then Ohyp(,j)(T) is undefined for any t 2 cr. If the former is not 
the case (then, |tail'^"^(cr)| - |tail'^"^(cr^)| + 1), then we concatenate the new values of <l)/tail'^"^(cr)) 
to Ohyp(;,y)(o-) if it belongs to Tp^. Formally, if 0/tail'^"^(o-)) c 0/tail'^"^(o-)) € Tp^, say 
0/tail'^"^(o-)) = <l)/tail^"^(o-"))~p, then we define <l>hyp(i-,;)(o') - *l'hyp(i,y)(o'~)''P- Otherwise, we 
set Ohyp(i,y)(cr) = Ohyp(;j)(o-). 

Now assume that Pq <^ Pi via a computable function O^., and 2o 2i via an eventually Lipschitz 
learner ^ with a constant c. We construct a learner A witnessing QoTPq <^ Q\ tPi . At first the learner A 
guesses the index A(()) = hyp(*F(()), e). Fix a e N"^^, and assume that A(cr") has been already defined. 
If *F(walk(cr)) i= *F(walk(cr")), then A also changes his mind as A(()) = hyp(4'(walk( cr)), e). Assume 
not. In the case |walk(cr)| > |walk(cr~)|, if either |walk(cr)| < c or walk(cr) ^ Tq^ is witnessed, the 
learner A changes his mind (this situation occurs only finitely often). Otherwise, the learner A keeps his 
previous guess, i.e., A(cr) - A(cr~). In this way, it is not hard to see that we may construct a learner A 
witnessing QofPo <l Qi^Pi- □ 

We may introduce the iteration of the hyperconcatenation T along any directed graph {V,E). However, 
the iteration of T does not represented by our dynamic proof model. We may introduce another new 
model called the nested disjunction model. 

The nested tape model: As an example, first we consider the nested disjunction T* = ^ a-eT°^ tst^ [^ct-t] 
along the graph G = ({0, 1,2), {(0, 1), (1,2))) with the initial vertex £ ^ 0, where T = {P") U {Pj-)^6N<N U 
{P^^)^o-^)g(jsj<N)2 is a given collection of subtrees of N^^. The nested tape model for T* consists of a 
collection {Aq} U {A°) U {A^)o-gN<N U {A^^^)^o- ,-)g(|^<N)2 of infinite tapes. 

Generally, a nested system (G, T, A) consists of a graph G = {V, E) with the initial vertex e, a collection 
T = {P^}vey,o-e(N-='*)^*' of (ill-founded) trees, and a collection A = {A□)U{AJ).}^,gyo-g(I^<N)<N of infinite tapes. 
A verifier *F is only allowed to write a letter on tapes which are available. Assume that a word pr[v, cr] 
is written on AJJ. for each v eV and cr e (N'^^)'^'^. Then, the availability conditions ai^e given as follows. 

• An and A^^ are available at each stage. 

• If a finite word v = <v[0], v[l], . . . , v[/]> is written on the tape Aq, then the following tapes are 
available. 

' V[v[0],<>]'' pr[v[l],pr[v[0],<>]]' " " " ' ' pr[v[i-l],pr[v[i--2],...,pr[v[l],pr[v[()],<>]]]] ' 

Here, on the tape Aq, the verifier ^ is only allowed to write a path starting from the initial vertex e 
within the graph G = (V,E). 

Example 136. On the nested tape model for T*, let a e {{ID {□}) x N)^^ be the record of a proof process 
of ^ by some stage, i.e., pr^(a) and pr(^, o-)(q'), for each (v, cr) e /^^, represent the words written on Aq 
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Figure 3. An example nested tape model when G is a linear order of length 3: (012) is 
written on A^; (101) is written on A"; (1001) is written on A}qj; then Aq, A*', A}qj, and 
A?n, are available. 



and AJJ., respectively. Here, / denotes V x (N*^ )^ . If the letter 1 representing the vertex I e V has been 
written on Aq (i.e., Tpr^{a) 2 (01)), then the thi^ee tapes Aq, A°, and Aj, are available, where p = pro(Q'). 

The verifier *F succeeds if he eventually writes a coiTect solution on some tape from A (i.e., some solu- 
tion / e [r^] is eventually written on AJJ. for some (v, cr) e Vx (N"^^)^^, or otherwise, some infinite path 
though G is written on An). For each M,ve yand(v,cr) 6 Vx(N<^)<^, the tuple {r^,A';^,r^.^,A'^.^)ren 
is called the (cr, v, u)-component of (G, T, A). The (cr, v, M)-component of our nested system consists of 
an infinite disjunction along an ill-founded tree, Ti-gT-v [r^^]. In other words, on the (cr, v, M)-component 
of the system (/, A, T,G), the set AJJ. plays the role of the declai^ation □, and A^^ plays the role of the 
working tape for each t e T^, as in the dynamic tape model. 

Definition 137. Fix a directed graph G = {V, E), and we denotes V x (N*^^)*^^ by /. Assume that a 
collection {T(v^cr)\(v,iT)ei of subtrees of N^^ are given. For or e ((/ U {□)) x N)^'*, we inductively define 
the n-th available index along a, p{a,n) e /, for each n < |prQ(ci')|, as follows. 

p{a, 0) ^ (e, 0), p{a, i + \) = (prn(a)(/), {p{a, 0)r(prp(„,;)(a')))- 

Then we define the set of all indices of available tapes along a by A(a) = {p(a, n) : n < |prQ(Q')|}. The 
set S{a) of successors of a is defined as follows: 

S{a) = {{p,n) e (/ U {□}) x N : e A{a) & v^piaTn e Tp) 

U {(□,v) : (prn(ff)(|prn(a)| - l),v) e E}. 

Then the nested infinitary disjunction V^o-eATcA £ ((/ U {□}) x N)^ o/{r^}(v,o-)e/ is defined by 

y^aeiVTA - {/ € ((/ U {□}) X N)N : {Sn e N) f{n) eS{f\ n)]. 
We can also define W^^ATA = {/ e V^^eATA : lprn(/)| < ~). 

Proposition 138. Assume that G is a computable directed graph, and {To-lo-e/ is a computable collection 
of computable subtrees o/N^, where I = Vx (N<^)<^. Then, Wa-eATa-] is n°. Moreover, ifO and 
are subtrees of 2'^^^ for each cr e I, then ^a^ATcA is (1, l)-equivalent to a 11^ subset of 2^. 

Proof. Note that a i-> A{a) is computable. Therefore, a i-> S{a) is also computable. Thus, Wa-eATa-] is 

Assume that G = {V, E(V)) and To- are subtrees of 2^^ for each cr e I. Fix new symbols -i-, - which 
does not belong to N. To construct a IIj subset of ({-i-, -) U 2)^ which is (1, l)-equivalent to Wo-eATo-], 
we inductively define a computable function head : ({-i-, -) 02)^*^ — > Z. Fix a = a (w) € ({-i-, -j U2)^^. 
Put head(()) = 0, Put head(Qr) = head(fl'") -i- 1 if w = -i-; put head(Q;) = head(Q'^) if w ^ {+.-}; and put 
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head(a) = head(Q'~) - 1 if w = -. If = a "(+, +> and head{a) = max{head(jS) : yS c or) + 2, or if 
head(a) = -1, then we say that a is overflowing. If a has an overflowing initial segment fi Q a, then we 
also say that a is overflowing. Let Rule denote the set of all non-overflowing strings a e ({+, -) U 2)^^ 
which has neither (+, -) nor <-, +) as substrings. Note that Rule is computable. 

We now inductively define p~rQ, p, and p~ro- for each cr eV. Put and p - {{)). Fix a - a w e 

Rule. Assume that p~rn(a~), and p{a~) have been already defined. If w e {+, -), then p~rn(Q') - ^T^{a~) 
and p{a) = p{a~). Assume w i {+, -}. Then, if head(Qf) > max{head(y6) then we define 

p~rQ(a) - ^r^ioTYw. Otherwise, set p~rn(Q') = ^T^ipT). If ii'^o^ioc) + Tp-r^{a~), then p{a) = p{a~)~{{}). 
Otherwise, define p{a) e (2<N)ina)l as follows. 

{p{a~)){n), ifn < head(a); 
(p{a))(n) = ■ {p{a~)){nyw, ifn - head(a); 

0, if h(a) <n< |prn(Q')|. 

Then, for each cr e V, we define Tpr^{a) = ipiP))i\cr\) for the greatest ji Q a such that cr c p{P). Set 
Rulev = {/ e ({+, -) U 2)^ : (V« e N) / \ n e Rule}. Note that any g € Ruley has no infinite {+, -}- 
sequence; otherwise g \ s for some 5 e N is overflowing or has a substring (+, -) or (-, +), and hence 
g \ s must go against Rule. Then P is defined as follows. 

P = {/ e Rulev : (V« g N) (pr^a r «) € V & (Vcr € /) pr^(/ \ n) e T^)}. 

Clearly, P is computably bounded, and 11°. It remains to show that P =} Wo-e/LPo-]- We first inductively 
define a computable function O witnessing P >{ Wa-ei[Ta-]- Set 0((» = (), fix a = a w e Rule, 
and assume that (^{a~) has been akeady defined. If w € {+.-}, then set <l)(a) = 0(a~). Assume 
w ^ {+,-}. If head(Q') > max{head(yS) : P Q a}, then we set O(q') = (^{a^)~{(n,w)). Otherwise, we set 
0(a) = <D(a")"<((prn(a),^(Q') [ h{a)),w)). It is not hard to check P >} Wo-g/[ro-] via O. 

To prove P >[ a-ei\J (A, we first define a computable function head*. Firstly put head*(()) = 0. 
Fix a = a"'{{o-,w)) e ((/ U {□}) U N)'^'^. If cr = □, then we set head*(Q') = \pra{a)\. If cr e I, 
then we set head*(Q') = |(cr)i|. Set <!>(()) = (), and assume that 0(q'") has already been defined. Put 
d = head*(a) - head*(Q'-). lfd>0, then ^{a) = <^{a-)- 'w. If J < 0, then O(q') = (^ia-)' -"^ ~w. 
It is not hard to check P <[ Wo-ei[To-] via O. □ 

If only depends on v e V, i.e., = Ty, then the nested system (/, A, T, G) can be viewed as the 
iteration of the hyperconcatenation T along the graph G. In this case, we write '\^ve(V.E)Pv for this notion. 

Proposition 139. Let (V, E) be a computable directed graph, and {Pvlvev be a computable collection of 
n° subsets o/N^. Then, Vive(V,E)Pv <\ ▼ve(K£)A.- 

Proof. We inductively define a computable function O which witnesses the condition Wve(K£)^v ^{ 
▼ve(K£)A.- Set <D«)) = (>. Fixer = a—{(u,i),(v,j)} e (V x N)<^. Assume that OCa-) has al- 
ready been defined, and 0{a~) is of the form 0(q'") = /3^{(cr,k)) for some yS € ((/ U {□}) x N)"^^, 
cr e / U {□), and ^ e N. If v = m, then we set <l)(a) = 0(a~)~((cr, j)). If v i= u, then we set 
0(a) = 0(a")~<(n,v),((v,(cr)rpr„(a)),7)>. Fix g € 'fve(v,E)Pv By induction, we can show pr^,[„](g t 
n+ I) = pr^[„](0(g r « + 1)), where g{n) = {v[nlj) and Q>(g [ n + I) ^ /3'{{o-[n], j)). Then, 
(cr[?i])i = (cr[?i]")i~pro-[„]-(0(g [~ n + 1)), by our definition of O. Therefore, cr[?i] is available whenever 
cr[n]~ is available. By induction, cr[n] is available at g \ n, for any n e N. Moreover, pro-[„](0(^)) = 
pr^,[„](g) € Tv[n] = Ta-[n], and pr^{(^{g)) = walk(g). Here walk(g) is inductively defined as follows. Set 
walkfe r 1) = (g(0))o. If (g(«+l))o = te(«))o,thenwalk(g [ n+l) = walkfe [ n). If te(« + l))o + {g{n))o, 
then waLk(g \ n + \) = walk(g \ n)~{g{n + l))o. Note that (walk(g; n), walk(g; n -i- 1)) e £" for each 
n < |walk(^)| - 1. Thus, <D(g; s) e S(<D(g) \ s) for any 5 e N. Consequentiy, <D(^) 6 y^ve{v,E)Pv □ 

If G - {V,E) is linearly ordered, then we have no choice of the next vertex at each stage. In this 
case, to simplify our argument, we assume that only {^cr]{v,<T)ei is given, i.e., the (v, cr)-th tape AJJ. does 
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not depend on the vertex v e V, and. Moreover, if To- - T-^ for any cr,T e I, then we only require 
{A|o-|)(v,o->e/- We will use the simplest depth n nested system. The system {G,T,A) is an N'^" -nested 
system if G = in,S) and Tg- = Tr for any cr,T e I. This system is equivalent to the n-th iteration of T. 
Let P^(°) - P, and P^("+i) = PjP''^"\ We also write TP for U„eN 

Proposition 140. Let G = (n + 2,S), where n + 2 = {me'N:m<n + 2} and S = {{m, m + I) : m < n}, 
and {PJJ-}(v,cr)6/ be d computable collection o/IIj subsets o/N^. Let denote the corresponding tree of 
P^^ for each (v, cr) € /. Then W(v,a->e//'J)- is (1, \)-equivalent to the following set: 

Q = ▼(r(0)er« (▼(r(l)er^,o, (■ • • (^<^(«)er;;(0),.....(„-i)C(0),...,(r(«)) •••))• 
In particular, Wvs(„,s)P = P''^''^ for any n° subset ofN^. 

Proof Straightforward. □ 
Proposition 141. For any 11° set P c 2^, the following conditions hold. 

(1) [Voo ];<„+! VP<\ P^^"^for each neM. 

(2) There is an (n + I, oj)-computable function p^("+i) — > p via a team {*!',•),■<„ of learners, where H'o 
is confident, and *P„ is eventually-Popperian. In particular, P TP. 

Proof. The item (1) follows from Corollary 125. To prove the item (2), we use the Ilj subset of 2^ 
corresponding to p^("+i) constructed as in Proposition 138. Then, on each a G N^^, the /-th leai^ner 
*F; guesses an index of '&'^p(a)\i- Note that V^p(a)\i = PJ^<> is partial computable. In particular, is 
confident. Fix ^ € p^("+i\ Then, lim^. *F,(g \ s) converges if and only iiXwcLsipig \ s) \ i) converges. 
For the greatest / such that limsipig I s) [ i) converges to some a e (2^^^)^', we must have pr^{g) e 
P. Thus, if lims*F,j(g [ s) converges, then Urns p(g [ s) converges to some a e (2^^^)^", and hence 
%m,%,tet.v)(.?) = P^Ag) £ P- In particular, is eventually-Popperian. □ 

Proposition 142. Let P be alf^ subset of N^, and Q be a subset of N^. If P Q by a team of n 
eventually-Popperian learners, then P^(") <^ Q. 

Proof. Assume that P p^(n+i) (g)P by a team {*P,};<„ of n eventually-Popperian learners. For f e Q, 
assume that the N^"-nested tape {Ao-)o-gN<n is given. Assume that the <7-th challenge of F is started at stage 
Sq. At the beginning of the stage Sq, all words on {Ao-)o-gN<" are removed. The learner F uses {Ao-lo-eN<" 
to get an element of P^("), at the ^-th challenge. The F(/ |~ Sq)-i\\ algorithm Or(/|-i^) which is guessed by 
F at stage Sq is denoted by F*. 

• We say that F* writes on cr at stage t if the learner F simulates the calculation of ^^'\^\(f\t){f \ 
on the tape A^- at stage t, i.e., the learner F tries to make pr^. o <I)r(/7.s,)(/ TO- ^^\^\(f\t){f \ 0- 

• We say that F* is currently-refuted on cr at stage ? -i- 1 if either *P|o-|(/ \ t + 1) *I'|o-|(/ \ or 

<i>>F|<,|(/rf+i)(/ \t+i)iTp. 

Now we describe the strategy of F*. The active leaf at the beginning stage Sq is the leftmost leaf 
0""' £ N^". At each stage t > SqOf the <7-th trial of the leai^ner F, his algorithm F* proceeds as follows. 

• F* writes on p \ n - m - I for the active leaf p at substage m of stage t, and goes to next stage 
f -I- 1 , if it is not currently-refuted. 

• If F* is currently-refuted on p |~ « - m - 1 for the active leaf p at substage m of stage t, then F* 
acts as follows: 

- The word written on the tape Ap^„_,„_i before stage Sq is extended to a leaf of Tp. 

- The active leaf is switched to (p \ n-m- 2)~(p(n - m - 2) -i- 1)" (00 ... 0) £ N<", i.e., the 
leftmost leaf of N*^" extending {p \ n-m - 2)~{p{n - m - 2) -\- I). 

- Go to next substage m+ I. 

• If F* is currently-refuted on () at some stage u, then the (q + l)-th challenge of F begins at stage 
u. 
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By the eventually-Popperian assumption, the word written on any tape must be eventually currently- 
refuted or belong to P, since P is 11°. Therefore, the learner F changes his mind at most finitely often. 
Since we have P g, R 

via {*fi}i<n, an element of P is written on some tape. Therefore, 
pT(«) pf{n+\) satisfied via the learner F, as desired. □ 

Definition 143. Let P be a 11° subset of 2^. For each a £ (9, we define the a-hyperweakening P^^") as 
follows. 

(1) p^(0) ^ p. 

(2) If a - 2^ then P''^"^ = PtP^(^). 

(3) If a = 3 • 5^ then P'"^"^ = P'{P''^'^'^"^\en- 

Remark. We can give another definition for P'^'-"\ in the case that a = 3 • 5". Let Pv{P„lneN denote 
'^creTpPa-, where put P^ ^ P„ if cr is the n-th node of Pp. Then P'"^"^ can be defined as PT{P^(*^(")))„gN- 
However, we will use the previous definition for P^(") to simplify our argument. 

Proposition 144. Let P c 2^ be a 11^^ set, and a e O be a notation. Then, the a-hyperweakening P^^") is 
a n° subset of2^\ 

Proof. The proof is straightforward, as in the proof of Proposition 100. □ 

Proposition 145. For any special 11° set P c 2^, if a,b e O and a <o b, then P^(*' does not (1, a))-cup 
to P^<"', i.e., for any set R c /fP^*") <^ P^(^) ® R then P^^"^ <l R. 

Proof. The assumption a <o b implies 2" <q b. Therefore, we have P^<^) <l P^'^"). By Theorem 126, 
P^^^") does not (1, w)-cup to P^^"'. Thus, P^'^) does not (1, w)-cup to P^("). □ 

Fix again any notation omega e O such that |<l>omega(i)lo - n for each n e N. 

Proposition 146. Let P be a special 11° subset of2^\ and a e O be any notation. For any set R c N'^, ;/ 
pj{a) ^<aj pjia-oomega) ^ ^ of eventually-Popperian learners, then P'"-"^ <^ R. 

Proof. If P^("^ <^ p(a+oomega) ^ team of eventually-Popperian learners, then this reduction 

is also witnessed by a team of n eventually-Popperian learners, for some n e N. In particular, by 
modifying this reduction, we can easily construct a team of n eventually-Popperian learners witnessing 

pj(a) <<W pT(fl-o<l)omega('!+l)) ^p Thcn, by PrOpOSltion 142, we have P^("-O<l'omega('0) pT("-0'l>omega(«+l)) (g, 

R ^ (pyp^(« o<i>omega(«))) By Thcorcm 126, p^(" oi'°mesa(«)) <i^ p Hence, P^^"'> <<'^ R is witnessed by 
a team of « learners, by Proposition 141. □ 

Corollary 147. For every a e O there exists a computable function g such that, for any 11° index e, if Pe 
is special then the following properties hold. 

(1) Pg(e,b) <Ij Pg(e,c) holds for every c <o b <o a, indeed, Pg(e,b) does not (1, cS)-cup to Pg{e,cy 

(2) Pg(^e,b) =1 Pg(e,c)for every b, c <o a. 

Proof. Let g(e, b) be an index of PI^^\ Then the desired conditions follow from Proposition 145. □ 

Corollary 148. For any nonzero (w, l)-degree a e f^, there is a {l,oj)-noncupping sequence of {I, a>)- 
degrees inside a of length (xf^^. (Of course, such a sequence is not computable.) 

Proof. Fix a n° set Pea. Pick a path p qO through O of order type a>^^. Then, {P^^"^}aep is a desired 
sequence, by Proposition 145. □ 

Remark. We may introduce the "nested nested" model, the "nested nested nested" model, and so on. 
Let Qy/P be ve(TQ,E(TQ))Pv, where P,. = P for each v 6 Tq. Then, for example, the nested nested model 
can be introduced as the iteration of w along any directed graph {V,E). Therefore, inside the {oj, 1)- 
degree of any n° set P c 2^*^, one may iterate this procedure as "nested nested nested . . . nested nested 
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..." Actually one may iterate ''nested nested nested . . . nested nested ..." along any directed graph, for 
example, along the con^esponding tree of P. If we call it a "hypernested" model, then, of course, we may 
introduce models which are "hypernested hypernested", and "hypemested hypemested hypemested", 
and so on. By iterating this notion along the coiTcsponding tree of P, we obtain a "hyperhypemested' 
model. Iterating this procedure, of course, we have the iteration of "hyper" along the correspoding tree 
of P. This observation reveals to us that there are a fine structure, a deep hierarchy, and a morass inside 
each {(JL>, l)-degree (or equivalently, each Turing upward closure) of a 11^ subset of 2^. 

4.8. Infinitary Disjunctions along Infinite Complete Graphs. 

Theorem 149. For every special DP^ set P, 2 c 2^ there exists a X^l set P c 2^^ such that Q ^^'^ P and 
P is (a>, \)-equivalent to P. 

Proof. We construct a 11^ set P c 2^ by priority argument with infinitely many requirements {fg, Qe]een- 
Each preservation (;Pe-)strategy will injure our coding (^-)strategy of P into P infinitely often. In other 
words, for each !Pe-requirement, P contains an element g{ which is a counterpart of each f ^ P, but each 

g{ has infinitely many noises. Indeed, to satisfy the ^-requirements, we need to ensure that there is no 

f — 

uniformly team-learnable way to extract the information of / e P from its code gg e P. Nevertheless, 
the global (^-)requirement must guarantee that / e P is computable in gg e P via a non-uniform way. 
Let {*F^}/<6(e) be the e-th team of learners, where b = b{e) is the number of members of the e-th team. 

Requirements. It suffices to construct a n*' set P c 2^ satisfying the following requirements. 



Here, the desired n',' set P c 2^^ will be of form P U {g^ : e 8l f e P]. 

Construction. We will construct a computable sequence of computable trees {r^ KeN> and a computable 
sequence of natural numbers {/liheN- The desired set P is defined as [IJ, r^], and h^ is called active 
height at stage s. We will ensure that the tree Ts consists of strings of length < /i^. The strategy for the 
f'e -requirement acts on some string extending the e-th leaf pe of Pcpa- 

We will inductively define a string jeia, s) € extending pe for each 5 e N and a eTpoi height < s. 
The map a i-> lim, yda, s) restricted to T'p' will provide a tree-isomoiphism between Pp^' and (IJ , TsY^', 
i.e., P n [pe] will be constructed as the set of all infinite paths of the tree generated by {lim^ 7e(Q', s) : a € 
Tp}. In other words, g{ is defined by Uac/ lin^i Te(Q', s), and each string yeia, s) is an approximation of 
ge ^ P witnessing to satisfy the requirements. 

We will also define a finite set M^ia, s) Q b for each 5 e N and a e Pp of height < s. Intuitively, 
Me{a, s) contains any index of the learner who have been already changed his mind \a\ times along any 
string extending a of length s, and the string 7e(a, s) also plays the role of an active node for learners 
in Me{a, s). To satisfy the -requirement, each leai^ner in M^ia, s) can act on ye(a, s) at stage s + I, 
and then he extends yeia, s) to some new string ye(a, s + I) of length h^, and injures all constructions 
of yeiP, s + I) for yS 2 a. We assume that, for any ck e Pp of length s, {M^iP, s)}^ca is a partition of 
{/ e N : / < b}. 

Stage 0. At first, put T, - {<)}, h, - 0, M,((>,0) = {/ e N : / < b], and y,«),0) - p,. 

Stage s + I. At the beginning of each stage s + I, assume that and h^ are given, and that M(,(Ji, s) 
and yeiP, s) have been already defined for each 5 e N and p e Tp of height < s. For each /, e € N and 
each T € 2^, the length-of-agreement function /^(t) is the maximal Z e N such that <I>vj/«(^)(t; x) I for each 
X <l, and <l>>p':(r)(''") £ Tq- 




: (V/ € P) / <r g{. 
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Fix a string a e Tp of length s, and then each / belongs to some Me(J3, s) for /3 Q a. In this case, 
the learner can act on jeiP, s). Then, we say that the learner requires attention along a at stage 
5 + 1 if there exists r £ of length hs extending jeiP, s) such that either of the following conditions are 
satisfied. 

(1) changes on {jeiP, s), t], i.e., there is a string cr such that jeiP, s) c^a Qt and *P^(cr~) *P^(cr). 

(2) or, 1[{t) > maxlli((T) : cr c y,(J3, s)}. 

Let Rs be the set of all a e Tp of length s such that some learner requires attention along a at stage 
s + I. For a 6 R^, let m(a) be the least m such that there is a string yS c cr of length m and an index 
/ e MeiP, s) such that requires attention along a at stage s + I. That is to say, some learner who 
has already changed his mind m{a) times requires attention. 

Claim. For any a,/3 e Rg, we have that a \ m(a) = fS \ m{p) holds or a \ m(a) is incomparable with 
yS r m(J3). 

Put R*, ^ {a I m{a) : a e R,}. Then, for yS e 7?*, let i(J3) be the least / e M{m{a), s) such that 
requires attention along some a 2 yS of length s at stage s + I. For /3 e 7?*, we say that *P^^^ ac?^' a? 
5+1. Moreover, for yS e 7?*., let T(yS) be the lexicographically least string t e of length hs extending 
ye(fi, s) such that t witnesses that the learner 4^^^^ requires attention along some a 2 yS of length s at 
stage s + I. Then /?** c 7?* is defined as the set of all y6 e R* such that changes on (yeifi, s), T(yS)]. 

For each yS e /?**, put M,(J3, s + \) ^ M^ifi, s) \ [iifi)}, and put Meifi-i, s + I) = M^ifi, s) U [iifi)] for 
p-i e Tp. For any yS ^ /?**, put M^ifi, s + I) = Meifi, s). For each yS e /?*, if y6'o- e Tp is length < s for 
some o" e 2^^, then put yeifS'cr, s+l) = t(P)~o-. IfaeTp of length < s has no substring yS e R*, then put 
ye{a, s + I) = jeipi, s). For each £ Tp of length s, if \ye{a, s +\)\ < hg then pick the lexicographically 
least node 7*(a, s + I) e such that lygCa, 5 + 1)| = h^ and y^Ca, 5 + 1)2 y£.(a, s + 1). Otherwise put 
'y*(a, 5 + 1) = 7e(Q', + 1)- Then, for each a~i e Tp of length s, put ye(a~i, s + I) = yl(a, s + l)~i. Put 
hs+i = max{ |'Xe(ci', s + l)\ : a e Tp & \a\ = s + l). Then we define the approximation of P at stage s+l 
as follows. 

r,+i = r, U {cr c y,{a, s + iyoh^^'-M»-''+i)l : a e Tp & \a\ = s + I & e eN]. 
Finally, we set P = [lJ.veN ^il- Clearly, P is a nonempty 11° subset of 2^. 
Lemma 150. lim., yeia, s) converges for any e e N and a e Tp. 

Proof. Note that yeia, s) is incomparable with yg(j6, s) whenever a is incomparable with /3. Therefore, 
Yeia, s) changes only when some learner in MeiP, s) acts for some yS c cr. Assume that yeia, s) changes 
infinitely often. Then there is yS c cr, ? e N and / € Mei/i, t) such that / e MeiP, s) for any s > t, and 
acts infinitely often. However, by our construction, g" - lim^ yeia, s) is computable. Additionally, 
since / e Mg(yS, s) for any s > t, lim„ ^'^j^^^ig" \ n) exists, and Oiim,, ^^^^^(g", \n)ig") £ Q- This contradicts 
our assumption that Q is special. □ 

For f € P, put g{ = IJjfc/ lin^v yeia, s). By this lemma, such gl exists, and we observe that P can be 
represented as P - P U {gg : e e M & f € P}. For each e eM and a e Tp, we pick a) e N such that 
yeia, s) = yeia, t) for any s,t > tie, a). 

Lemma 151. The P-requirements are satisfied. 

Proof. Assume that P P via the e-th team {Y,),<fo of leai^ners. Then, for any f € P, there is i < b 
such that lim„ \ n) exists and ^y^^ ^j.^^f |-„)(<?e ) ^ 2- Since lim„ ^iigj, \ n) exists, there exists a <z f 

such that / e Meia,tie,a)). However, by the previous claim, no learner in IJyjca ^eO^, a)) requires 

f f 
attention after stage tie, a). This imphes lim„ l^ige I n) < oo. In other words, <l>jj^ ^ ^£ \n)^S<; ) ^ Q- This 

contradicts our assumption. □ 
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Figure 4. The dynamic proof model for a special 11° set P c 2^. 
Lemma 152. The ^-requirements are satisfied. 

Proof. It suffices to show that / <t g{ for any e e N and f € P. Assume that {^,|,</j is the e-th team 
of learners. Let denote the set of all / < b such that lim„ ^iigl \ n) converges. By our construction 
and the first claim, if / e h{ then / € Mgiui, t(e, a,)) for some ai c /. If / ^ h{ then for any a <z f there 
exists s such that / £ M^ia, s). Set / - max.^^/ |a,|, and u = max.^^/ t{e, a,)- For n > /, to compute f{n), 

^ f ^ 

we wait for stage v{n) > u such that, for every i ^ Hg, i e Meif \ m, v{n)) for some m > n + 1. By our 
construction, it is easy to see that we can extract f{n) from y^if \ n + 1, v(«)), by a uniformly computable 
procedure mn. □ 

Thus, we have Q i^"^ P by Lemma 151, and P c P c Deg(P) by Lemma 152. Thus, P is a n',' set 
satisfying Q P =^ P. This concludes the proof. □ 

Corollary 153. For any nonempty 11^ sets P,Q Q 2^, if Q Deg(P) then Q contains a computable 
element 

Proof. Assume that Q Deg(P) is satisfied. Suppose that P has no computable element. Then, 
for P, g c 2^, we obtain Q ^^'^ P =^ P by Theorem 149. Note that the condition P P implies 
P c Deg(P). Then, Q Deg(P) <} P. It involves a contradiction. □ 

5. Characterizations, Applications, and Questions 

5.1. Characterization by Piecewise Computability. We can introduce the iteration of v and Va, for 

any subsets of Baire space N^. We also introduce the concatenation P~Q for any sets P,Q Q N'^, as the 
noncommutative version of |[P V 23lcm[2]" 

Definition 154. Let P, Q be subsets of Baire space N^. 

(1) The concatenation ofP and Q is defined as follows. 

P'Q^PU {(T'tg : (T e & g 6 2}. 

(2) VlP-P;andVLiP = P-Vi^- 

(3) [Voo ]i P = 1/ e (N X Nf : (3/ < n) pr^/) e P}. 

(4) [V^ ]Ip = [Voo Yn H {/ e (N X N^) : mc(/) < cx,}. 

(5) V ^ = Vi and Voo ^ = U,« [Voo t P- 

Remark. Recall that |[P v 2]1lcm[2] l)-equivalent to IP v 2Ilcm[2]- ^^^^ ^^^^ l)-equivalent 
to Pv2 for ITj sets, and we also have PvP =j P~P. We may also consider Vie(y,£) for a collection 
[Pv]v&v of any subsets of N^, by setting Con(rp,,)vgy = {V x N)^, for a fixed directed graph (V, E). Then 
one can also introduce V^^^ P as the dynamic disjunction of P along a linear order of cardinality m. 
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Definition 155. For a class T of subsets of Baire space N , we say that a collection {2,},eN is T if the set 

{(/, /) e N X : / e 2,) belongs to T. A partition {Qihen of 2 is T if there is a T collection {Q*}ien such 
that 2i = 2 n Q* for any / e N. We say that {2i)(sn is a F layer of Q if there is a F collection {Q*}ie-N 
such that Q* c Q*^^ for each / e N, {2*)(eN covers Q, and Qi = Qn Q*. We also say that {Qi}im is a F 
d-layer of Q if there is a F layer {2*}i'eN of Q such that Qi = Q* \ Q* ^ for any / e N, where 2*j = 0. 
Note that every F J-layer of 2 is a (F)2 partition of Q. Here a set 2 £ is (F)2 if it is the difference of 
two F sets. 

Theorem 156. 

(1) The following are equivalent for any P,QQ N^; 

(a) P <L Q- 

(b) There ismeM such that \j]„P <\ Q. 

(c) There is a finite Hj d-layer {Qi]i<m of Q such that P <[ Qtfor any i < m. 

(2) The following are equivalent for any P,QQ N^; 

(a) P 2- 

(b) There is meM such that [SJ^ ]^^^ P <\ Q- 

(c) There is a finite A2 partition {2; };<m ofQ such that P <} Qifor any i < m. 

(d) There is a finite S2 cover {Qi]i<,n of Q such that P <j Qifor any i < m. 

(3) The following are equivalent for any P,QQ N^; 

(a) P <l Q. 

(b) yP<\Q. 

(c) v^<l ve- 

(d) There is a Hj partition {2!)ieN ofQ such that P <\ Qi uniformly in i 6 N. 

(e) There is a ^2 cover {2!lieN ofQ such that P <\ Qi uniformly in i e N. 

Here, we say that P <{ /?; uniformly in / e N if there is a computable sequence {e(/)),gfj of indices 
such that P <\ Ri via (^e(i)for any i e N. 

(4) The following are equivalent for any P,QQ N^; 

(a) P <T Q- 

(b) There ismeM such that [\J^ ]Ip <\Q. 

(c) There is a finite partition {Qi}i<m ofQ such that P <} Qifor any i < m. 

(5) The following are equivalent for any P,QQ N^; 

(a) P <r Q- 

(b) There ismeM such that [Voo li V ^ ^1 Q- 

(c) There is a finite partition {2?!(<m ofQ and FI? partitions {Q} J/gN o/2? that P <\ Q] , 
uniformly in (i, j) e mx N. 

(d) There is a finite partition {Q^]i<,„ of Q and Z2 covers {2,-y};eN of Q^ such that P <} 2,-^ 
uniformly in (i, j) e mx N. 

(6) The following are equivalent for any P,QQ N^; 

(a) P 2- 

(b) Voo^<I Q- 

(C) V«,^<I VooG. _ 

(d) Deg(P) 2 2. where Deg(P) denote the Turing upward closure of P. 

(e) There is an infinite partition {Qi}iehj ofQ such that P <j Qifor any i e N. 

Proof. Item 1 (a)^(b): Assume that P Q via a learner ^ with mind-change-bound n. We need 
to construct a computable function A witnessing Vn^ -} Q- For any g & Q, by uniformly com- 
putable procedure, we enumerate the mind-change location along g of the learner ^, a finite sequence 
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{mclvy(g; i)}i<:k of length ^ < ?i, as follows. To simplify out argument, put mclvp(g; -1) = (>. For a given 
mclvp(g; / - 1) e 2*^^, we wait for mclvp(g; /) = minjr : inclvp(g; i) c t c g & ^(mclvp(g; /)) i= ^(r)). If 
we find mcl>p(g; /), then we next wait for mclvp(^; / + 1). Finally, we define A(g) as follows. 

Mg) - O>p(())(mcl>p(g;0)^)'~S 



n 



~1>'F(mcl^.te;|mclte)|-l))fe)- 



L(<|mcl(g)|-1 

It is easy to see that A is computable. Note that, tail(A(g)) = ^^'{mci^ig;\mciig)\-i)){g) £ P, since P Q 
via *P, and lim^ I s) converges to *F(mclvp(^; |mcl(g)| - 1)). Furthermore, (J occurs k times in A{g), 
and k < n because of mind-change-bound n. Thus, A(g) e Vn ^ for ^^ly ^ e 2, as desired. 

Item 1 (b)— >(c): For each cr e N^^ let count(cr) denote the set #{n < |o"| : o"(?i) = ft}. Assume 
that SJIjP <\ Q via a computable function O. Then 0(g I n) < m for each n e N and any g e Q. 
Define 5,- = {t e N"*^ : count(<l)(T)) < /), for each / < m. Clearly, {[S'/DKm is a uniform increasing 
sequence of IIj sets. Moreover, lim„ count(<l)(g [ n)) < m for every g ^ Q, since S/^„P <\ Q via 
O. This means g € [Si] for some / < m. Therefore, Q c IJ,<;„[S;]. For a given g e 5, \ we 
calculate the i-th mind-change location along g with respect to ft, mcljj(g; /) such that <l)(g;mcl(|(g; /)) is 
the i-th ff in <^{g), i.e., mcljj(g;/) is the least m such that count(<l)(g) \ mcl^{g;i)) > i. Then we set 
r,.(g) = 0(g)^'"'=^«'«''^+\ where recall that h'~'' denotes the ^-th shift of h, h^'' = An.h{n + k). It is easy to 
see that P<\Qr\ ([S,] \ via F,. 

Item 1 (c)— >(a): Assume that Q c |J,<„, Qi for some computable increasing sequence of 
sets, and P <\ QC\ (Qj \ Qi-i) via a computable function <l>e(,). For each cr e N^'*', we compute the least 
/(cr) such that cr e Tg.,^^,, i.e., cr e Tq.^^^ \ Tq.^^^ ^. Then, on cr € N^^, the learner ^ guesses *P(cr) = 
e(/(cr)). By our assumption, for any g e 2, we have g £ 2; for some / e N. Then, lim„ ^{g \ n) converges 
to the least e{i) such that g e Qj. Again, by our assumption, we have ^\im„^(g\n){g) = ^eioig) £ P for 
any g e 2 n (2,- \ Therefore, P 2 via the learner ^. 

Item 2 (a)— >(b): Assume that P <^|^^ Q via a leaner ^, where t ■5') : ■5' £ N| < w for any 

g e Q. We need to construct a computable function A witnessing ^\J^ | P <\ Q- We define £(cr) for 

each cr 6 N^^. Put e(()) = 0. Fix cr £ N^^, and assume that e(T) has been already defined for each 
T c cr. If ^(cr) = ^(t) for some t c cr, then we set £(cr) = e{T) for such t. If there is no such t, then we 
set e(cr) = max{e(T) : t c cr} -h 1. Pick the greatest substring t c cr such that ^(t) = ^(cr). Then, define 
77°" = (l)vj/(o-)(cr)"'l'''*<'^>^^^l. Then, 0>p(o-)(cr) = 0>p(o-)(t)"77°". Here, if there is no such t, then we may assume 
0>p(o-)(t) = (). Assume that A(cr^) has been already defined. Then, put A(cr) = A(cr~)~write(e(cr), 77°"). 
Here, recall that write(e(cr), 77°") - e(cr)l''(°"^l © 77°" - <e(cr), 77°" (0), . . . , e(cr), 77°"(|77| - 1)) represents the 
instruction to write 77 on the £(cr)-th tape. Fix g ^ Q. Note that E{g I s) < n for each 5' € N, since 
f 5) : 5 e N) < «. Thus, we have A(g) € {nx M)^. Moreover, mc(A(g)) < 00, since ^ is a learner 
converging on Q. Thus, lim^^(g \ s) and hence Um^eCg \ s) converge. Therefore, priini^e(g[^i)(A(g)) = 

%m.,>P(gr.)te) e P- Hence, [V^ P <\ Q. 

Item 2 (b)— >(c): Assume that [Vtj]^^ -1 Q ^ computable function O. For any p e N, set 
= {g e : {Vm){3n > m) (0(g r «))o = p\ and = {g e N^^ : (3m)(Vn > 77i) ((D(g t «))o = pl- 
Then 2 n 2" = 2 n 2^ = {g e 2 : lim«(<I'(g T i))o ^ 7?) for any p e N. Note that, for any g e g, we 
have g e 2^ for some p < b, since (0(g C ?7))o < b for each 71 e N. Therefore, {Q n 2^ };,</, is a finite A2 
partition of Q such that P <} Qp via the computable function pr^ o (J). 

Item 2 (c)^(d): Obvious. 

Item 2 (d)— >(a): Assume that there is a finite ^2 partition {Qp]p<b of Q such that P <} Qp via 
for any p < b. Then, there is a computable relation P c N x N^*^ such that Qp - {g ^ Q '■ i3m){Wn > 
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m) R{p,g r ri)}. We set ^(cr) - e(min({p : R(p,(r)} U {b - 1})). For any g e g, we have g & Qp for 
some p < b, since Q c ljp<^ Qp. Therefore, hm„ [ n) converges to some value e{p), where g e Qp. 
Hence, it is easy to see that P <lj Q via ^. 

Item 3 (a)^(b): By similar argument used in proof of "Item 1 (a)^(b)." 

Item 3 (b)— >(d): For each cr e N^^ let count(cr) again denote the set #{« e N : crin) = ji). Assume 
that V ^ -1 2 ^ computable function O. Define 5, as follows for each / e N: 

S,- - {r £ N''^ : |t| < / or (V?) {i < t < \t\ count(0(T)) = count(0(T \ t)))}. 

Clearly, {[S'/DieN is a uniform increasing sequence of Flj sets. Moreover, the limit lim„ count(0(g I 
n)) converges for every g e Q, since ^1 2 ^- This means g e [5,] for some / e N. Therefore, 
Q £ Ufi*^!']- Foi' ^ given g & Q, F,- computes the last mind-change location along g with respect to f|, 
mcljte r = max{;n < |0(g \ i)\ : 0(g \ i;m) - ft) + 1, and set F;(g) = (D(g)^"'^^3'^^'l It is easy 
to see that {F,),gN is uniformly computable, and P <\ Q C\ [5,] via F,. Set Qi = [5,] for each / e N. 
Then \ Qj = [JneniQi+i ^ where pj, is the «-th leaf of the corresponding tree of Qi. We set 
Qi+i,n = Qm n [p'j. Then {Q n Qq] U {Q n e,+i,„),>eN is a partition of Q, and P <\ Q n Q^,, via 
Tj+\, for each /, n e N. 

Item 3 (d)— >(e): Obvious. 

Item 3 (e)^(a): Assume that there is a partition {Qp]pei>,j of Q such that P <\ Qp via ^eip) for 
any p e N. Then, there is a computable relation /? c N x N*^^ such that Qp = {g ^ Q (3m)(V« > 
m) R{p,g \ n)}. We set ^{cr) - e{mm{p : R{p,o-)\). For any g e 2, we have g e Qp for some e N, 
since Q c IJ^ gp. Therefore, lim„ T(g |~ «) converges to some value e{p), where g e Qp. Hence, it is 
easy to see that P <lj Q via 

Item 3 (b)^(c): Note that Q=lSjQ. Thus, V ^ <I 2 if and only if P <l Q if and only if P <i V 2 
if and only if V P <{ V 2- 

Item 4 (a)— >(b): Assume that P Q via a finite collection {0^}^</, of partial computable functions. 
We need to construct a computable function A witnessing [\J^ ]l ^ -\ 2- For cr e N^^ and e < b, we 
define r]^ = <l)e(o")"*l*^^^'^ i.e., Og(cr) = <l>e(o"~)~?7^. We recursively construct a computable function 
^ ■ Q ^ [ Voo ]b P- Assume that A(cr") is already defined. Put A(cr) = A(o-")~ ne</) write(e, 77^). Note 
that prg(A(g)) e P if Og(g) e P. Thus, for any g € 2, we have prg(A(g)) e P for some e < b. In other 
words, [Vco]fo^<! 2 via A 

Item 4 (b)^(c): Assume that [Vcoli,^ ^1 2 via a computable function O. Set Qe = {g ^ Q '■ 
Tprg{(^{g)) 6 P). Then, it is easy to see that {Qe\e<b covers Q, and P <[ Q^, via pr^ o Q? for each e < ft. 

Item 4 (c)— >(a): Assume that there is a partition {2,),<,„ such that P <j via a computable function 
0(,(,) for any / < m. Then, P <\ Q via {O^ : j < max,<,„ 

Item 5 (a)^(b): Assume that P via a team {*F,},<fo of learners. We construct a computable function 
A. We first set A((» = (). Fix cr € N^^, and assume that A(cr~) has been already defined. We define 
7]f e N*^^"^ for each i < b as follows. Fix / < b. If ^i{o-) = ^'i{cr'}, say Ovi-;(o-)(cr) - Ovi-;(o-)(cr")'~T for 
some string r e N"^^, then let rjf be such t. If ^,(cr) ?t *F,(o""), then we put 77°" = J1~<1)'f,(o-)(c'")- Then, 
we define A(cr) = A(cr~)~ ni</) write(/, T/p. Pickg € Q. Then, by our assumption, ^iim„Wi(gin)ig) £ P 
for some / < b. Then tail(prj(A(g))) converges, and tail(pr/(A(g)))^^ = <l>iim„'P,(^)r«)(,?) ^ P- Thus, 

Ate)€[Vco]^V^- 

Item 5 (b)^(c): Assume that [VcoJ^ A 2 

via a computable function Set 2'^ = (,? ^ 2 • 
pr,(0(g)) £ V^)- Then, it is easy to see that {Qe]e<b is a partition of Q. Then we can use the similar 
argument as in proof of "Item 3 (b)— >(d)." 
Item 5 (c)^(d): Obvious. 



60 



KOJIRO HIGUCHI AND TAKAYUKI KIHARA 



Item 5 (d)^(a): Assume that there is a finite partition {2^},<m and l.^ partitions [Q] j}jen of such 
that P <j Qj J via ^eiij) for any (/, j) e mx N. Then, there are computable relations /?; c N x N^^ such 
that Q}. ^ {g e e° : {3m){Vn > m) Ri{j,g [ n)}. We set ^,(cr) = e(/,min{7 : RiU,cr)]) for each / < m. 
For any g e 2, if g e 2°, then we have g e Qj j for some j £ N, since c IJ^gj^ Q. j. Therefore, for 
any g e Q9, the limit lim„ *F;(g [" converges to some value e(i, j), where we must have g e Q'. for such 
j e N. Hence, by our assumption, we have P <^'^ Q via a team {^i}iKm of learners. 

Item 6 (a)— >(b): Assume that P Q. We need to construct a computable function A witnessing 
Voo^ ^1 Q- For cr £ and e < |o-|, we again define 77^ = Og(cr)^l*'('^ i.e., (De(o-) ^ <Dg(o-)"?7^. 
We recursively construct a computable function A : 2 — > P. Assume that A(cr") has been already 
defined. Put A(cr) = A(o-)-(n^<|^| write(e, ?7^))-(write(e, O^(cr))). Note that pr^(A(^)) = (D,(g). 
Thus, for any g e Q,we have prg(A(g)) £ P for some e £ N. In other words, Voo P ^\ Q via A. 

Item 6 (a)<-^(d): Obvious. 

Item 6 (b)^(e): Assume that Voo P ^\ Q via a computable function Set G^. = £ 2 : prg(<l)(g)) £ 
P}. Then, clearly {2e}e<Z) covers Q, and P <} 2^ via a computable function pr^ o <I). 

Item 6 (e)— >(a): If there is an infinite partition {2,},eN of Q such that P <[ Qj for any / £ N, then, in 
particular, Qi c Deg(P) for any / £ N. This imphes Q = lJ,gN Qi £ Deg(P), and hence P Q. 

Item 6 (b)<^(c): Note that Q ='j^ Voo Q- Thus, Voo^ 2 if and only if P <'j^ 2 if and only if 
/'<r Voo e if and only if Voo Voo e- □ 

Proposition 157. Let P, Q be 11° subsets ofBaire space N^. 

(1) P <Jj'J' 2 if and only if there is a finite cover {2r)r<n o/2 ^c/i f/zaf P <} Qifor each i < n. 

(2) P <fi I Q if and only if there is a IT*' cover { 2; Ir'eN of Q such that P < } Qifor each i £ N. 

(3) P <^'^ 2 if and only if there is a finite d-layer {2()(<n of Q such that P <} Qifor each i < n. 

(4) P Q if and only if there is a partition {2(}!eN ofQ such that P <} Qi uniformly in i £ N. 

Proof. For the items 1 and 2, we assume that P <^^y Q via a collection {0,);eN of total computable 
functions. Note that 0"^(P) is IIj, whenever is total computable, and P is IIj. Thus, it is easy to show 
that Qi = Q 0ri(P) satisfies the desired condition. We next assume that P <{ Qi via for each 
/ £ N, where we do not assume that / i-> e,- is computable. Then O^, ■ Qi ^ P can be extended to a total 
computable function on N^, since Qi is 11°, for each / £ N. Therefore, P <'^^y Q via {<l>e, },gN- 

For the items 3 and 4, we assume that P Q. Then, by Proposition 50, there is a computable 
function »P : N^^ ^ N such that liminf„'F(g \ n) e P for any g £ 2- We put Qe = {g ^ Q ■ 
liminf,, Y(g \ n) < e\ for each e £ N. Then, the collection {2eleeN is uniformly H^, and it forms 
a layer of Q, i.e., UeeN 2e covers Q. Moreover, for each e £ N, we have P <} Qe\ Qe~i via O^, 
where 2-i =0- Thus, {2e \ 2e-i}eeN is a 11° J-layer of 2> and P <} 2e \ 2e-i uniformly in e £ N. 
Furthermore, each (112)2 set 2e \ Qe~i is divided into infinitely many II^ sets as follows. For each e eN, 
let {2"_i}HeN be a uniform collection of 11° sets such that lJ„gN is the compliment of Qe~i, i.e., 
Qe \ Qe-x = n U„eN G^^i - U^eNCQ. H 2^_i). Then, P« - 2. H 2:_i is n°, for each f',?! £ N. Note 
that we can calculate an index of such collection {P")„eN from any E°-indices of 2e-i and 2e- Thus, 
{^e}e,«eN is a 11° partition of 2. and P <} P" via Og, for each « £ N. □ 

The direct sum © is also called the disjoint union U. It is also correct that, for 11° sets, if P and Q are 
disjoint, then P ® 2 is equivalent to P U 2 modulo the (1, l)-equivalence. However, if P and Q are not 
n°, the above claim is false, in general. 

Proposition 158. 

(1) For every sets P,QQ N^, the following conditions are equivalent: 
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(a) There are computable functions F,- '■ Qi ^ P with a finite 11^ partition {Qi}i<m of Q. 

(b) There is a computable function T . Q —> P. 
In particular, ifPr\Q = %, then PlJQ=\P®Q. 

(2) For any special 11° set P c 2^, there exists a {Ii\)2 set 2 c 2^ such that P n Q - & but 
PUQ<\P(BQ. 

Proof. For the item 1, we assume that F; ■ Qi ^ P is computable for each / < m with a finite flj partition 
{Qi}i<m of Q- Then we can extend each function F, to a total computable function F*. For a given g e Q, 
we wait for g ^ Qj for m - 1 many j's. By this way, we can calculate such / < m such that g i. Qj for 
each i i. Then Fj(g) e Q. For the item 2, put Q - {PvP) \ P. For any g ^ Q, there is a leaf p € Lp such 
that p c g. So we wait for such a leaf p e Lp. Then belongs to P. Hence, P <} Q. Thus, we have 
P <\P®Q, while PUQ = PvP <\ P by Theorem 83. □ 
Corollary 159 (As piecewise computable functions). 

(1) There exist 11° sets P,Q which satisfies (b)&-'(a): 

(a) There are computable functions F,- '. Qi ^ P with a finite 11° partition {Qi]i<m of Q. 

(b) There are computable functions F,- '■ Qt ^ P with a finite 11° cover {2, },<m of Q. 

(2) For every special 11° set P c 2^, there is a n° if-? 2 c 2^ w/j/c/j satisfies (b)&^(a): 

(a) There are computable functions F,- '■ Qi ^ P with a finite 11° partition {Qi]i<m of Q. 

(b) There are computable functions F,- '. Qi ^ P with a finite 11° d-layer {Qi}i<m of Q. 

(3) There exist 11° P, 2 c 2^ which satisfies (b)&-i(a): 

(a) There are computable functions F,- '. Qi ^ P with a finite 11° d-layer {2,}/<m o/Q. 

(b) There are computable functions F,- : Qi ^ P with a finite A° partition {Qi}i<,n of Q. 

(4) There exist 11° ie?^ P, 2 c 2^ which satisfies (b)&-'(a): 

(a) There are computable functions F,- '■ Qi ^ P uniformly with a X° cover o/Q. 

(b) There are computable functions F,- '. Qi ^ P with a finite 11° d-layer {Qi}i<m of Q. 

(5) There is a special 11° ^e? P c 2^^, the following conditions are equivalent for any 11° ^e? 2 c 2^; 

(a) There are computable functions F,- '■ Qi ^ P with a finite 11° d-layer {2, }i<,„ o/Q. 

(b) There are computable functions F,- '. Qi ^ P with a finite S° cover {2, ),<,„ o/Q. 

(c) There are computable functions F,- '. Qi ^ P with a finite 11° d-layer {Qi}i<m of Q. 

(6) For every special 11° ie? P c 2^, f/iere w a 11° ^ef 2 c 2^ which satisfies (b)&.-i(a): 

(a) There are computable functions F,- '. Qi ^ P with a finite 11° d-layer {2, },<m o/Q. 

(b) There are computable functions F,- '■ Qi ^ P uniformly with a 11° partition {2;},gN o/Q. 

(7) For every special 11° i'ef P c 2^, f/zere a 11° ^ef 2 c 2^ which satisfies (b)&-i(a): 

(a) There are computable functions F,- '. Qi ^ P uniformly with a S° cover {2i),gN o/Q. 

(b) There are computable functions F, : . P uniformly with a finite 11? d-layer {2°),<m 

"•J I, J Z I 

and n° partitions {2,-y)yeN ofQ*^. 

(8) For every special 11° ^e? P c 2^, ?/jere a 11° ie? 2 c 2^ which satisfies (b)&-i(a): 

(a) There are computable functions F, ; : 2? ■ ^ P uniformly with a finite 111' d-layer {2°),<m 
aniif 1° covert' {2'j);eN o/G°. 

(b) There are computable functions F,- ' Qi ^ P uniformly with a 11° partition {Qi}ien ofQ. 

Proof. Item 1. By Corollary 54 (2), Proposition 157 (1), and Proposition 158 (1). Item 2. By Corollary 
88, Theorem 156 (1), and Proposition 158 (1). Item 3. By Corollary 59 (2), and Theorem 156 (1,2). Item 
4. By Corollary 61 (1), and Theorem 156 (3), and Proposition 157 (3). Item 5. By Theorem 72, Theorem 
156 (1,2), and Proposition 157 (3). Item 6. By Corollary 118 (2), Theorem 156 (3), and Proposition 157 
(3). Item 7. By Corollary 129, Theorem 156 (3,5). Item 8. By Theorem 149, Theorem 156 (5), and 
Proposition 157 (4). □ 
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Definition 160 (Hyperconcatenation). For any strings cr e (N U {pass})^*^ and t e (N U {jl.pass))* 
the content of cr, content(cr), and the walk of t, walk(T), is inductively defined as follows. 



content(()) - {), content(cr) 



walk(T r 1) = 0, walk(T) 



Icontent(o- ) cr{\cr\ - 1) if cr{\cr\ - \) i= pass, 

content(o"") otherwise. 

walk(T-)-v if t(|t| - 2) - & - 1) = v, 
walk(T") otherwise. 



Then, the content of / e (NU {pass})^ and the walk of g e (NU ((j, pass))*^ are defined by coritGrit(/) = 
UneN contGnt(/ \ n) and walk(^) = lJ„gN walk(^ \ n), respectively. Let P and Q be any subsets of 
Baire space N^. The hyperconcatenation QfP and the non-Lipschitz hyperconcatenation QJ°P of Q 
and P are defined as follows. 

QJP - e (N U mf ■■ walk(g) e Q or tail{gr' e P], 

Qj°p ^ {g e (N U {ti,pass})^ : content o walk(g) e Q or tail(g)^^ e P}. 

Theorem 161 (As the Law of Excluded Middle). 

(1) The following are equivalent for any P,Q,RQ N^.' 

(a) Q'P <\ R. 

(b) There is a sentence with computable functions Og(0), ^e(\) such that 

• if g € 7? satisfies ip{g), then (i>e(0)(g) £ P; 

• ifgeR satisfies -'(pig) then <l>^(i)(g) e Q. 

(2) The implications (b^) (a) (a') ^ (b') hold for any P,Q,RQ N^.- 
(a) Q^P <\ R. 

(a-) Qy°P <\ R. 

(b"*") There is a sentence p = 3v6{v) with a uniform sequence {r, ),gn, A of computable func- 
tions such that 

• if g € R satisfies 6{v), then Ty{g\ u) ifor any m e N, and Ty{g) e P. 

• ifg £ R satisfies -'9(v), then A{g; u) ifor any u <v, and [A{g) \ v + I] intersects with 
Q. 

(b ) There is a sentence p = 3v9(v) with a uniform sequence {r, ),gN, A of computable func- 
tions such that 

• ifg e R satisfies 6(y), then Tv{g\ u) ifor any m e N, and Ty{g) e P. 

• if g € R satisfies -^3v9{v), then A(g; u) ifor any w e N, and A(g) e Q. 

Proof. Item 1 (a)— >(b): The desired Ej sentence is defined as ip{g) = {3n) n) = jj. 

Item 1 (b)^(a): Assume that there is a Xj set S c such that P <\RnS via Og(0), and Q <\ R n S 
via 0^,(1). Since S c N'^ is iP^, there is a c.e. set Ws such that cr e W5 if and only if [cr] c S . For a given 
cr 6 N^^, if there is no « < |cr| such that cr [ n e Ws, then set r(cr) = <l>e(i)(cr). If there is n < |cr| such 
that cr I n e Ws, then, for such n, set r(cr) = Ot.(i)(cr [ «)~Jj'~Og(0)(cr). Then, it is easy to see that F is 
computable, and Q~P <} R via F. 

Item 2 (b+)— >(a): Assume that Sj = {g ^ : &ig',i) Tl for some computable function 0, and that 
P <\Rn Si via F; and Q<\R \ UieN^i via A. For a string cr e N<^, define (i(cr) and ?(cr; /) as follows: 

J(cr) = max{d e N : (V/ < d) ©(cr; /) J,); 
tier; i) = mini? e N : 0(cr [ t; i) J,), for any / < d{cr). 

Then let us define A(cr) ^ ni<d{cr) i^iio' t Kcr; A(cr; /)) "Frf(^)(cr). 

Item 2 (a^)^(b~): Assume that Qf°P <\ R via a computable function <D. Set 5,, ^ {g e : (V?i > 
v) 0(g; n) (|). For a string cr e N^*^, we first computes the following count(cr) and mcl(|(cr, n) for each 
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neN: 

count((T) = #{m < \cr\ : (^{cr; m) = ft}, 

mcl||(cr, = min{m < |cr| : count(cr I m) > n}, if such m exists. 

Then set T,.{o-) - (D(cr)^™'^i«('^'"""^(^^^»+i; and set A(o-) - ^?i.O(cr,mclft(o-,n)). Note that if geRn St 
for some k eN, then Ttig) e P; otherwise, A(g) e Q. Therefore, P <\ R r^ S „ vinYy and Q <\ R \ S via 
A. 

Item (b^)^(a"): For each cr e N^^, let v(o") be the least v such that v, cr) holds for all u < |cr|, 
where ^{g) = (3v)(Vm)/?(m, v, g t u). We inductively define a computable function <1) as follows. We first 
set 0(0) - {). Assume that <l>(o"") has been already defined. 



0((r) = 



0(cT-)-y, if v{cr) = via') & r,(^)((r) - tail+((D((r-))~7, 

0(o--)-(tt, (5(0)), if v(cr) ?t v(cr-) & A(cr) = content o walk((D(o--))-(5, 
0(0-")" (tt, pass), if v(a-) ?t v(cr") & A(o-) = content o walk(<D(o-")). 



For any g e N^, if (p{g) = {3v){Wu)R{u,v,g [ u), then for the least such v 6 N, we have tail"^(0(g)) - 
Ty{g). Otherwise, we have content o walk(<l)(g)) = A(g). Hence, <l)(g) e Qf°P, for any g e R. □ 

Remark. For degree structures D„ and on !P(N^), each operator : !P(N^) ^ 'P(N^) induces the 
new operator 0^,- : D„ ^ 2)r defined by 0„r(deg„(P)) ^ deg^(0(P)) for any P c N*^. We identify O with 
Our whenever is well-defined. Recall that every partially ordered set can be viewed as a category. 
Sorbi [68] showed that Deg : i)^ ^ D} is left-adjoint to id : D\ ^ D^, and id o Deg : i)^ ^ 
is identity. He also showed that Deg : D\ preserves the supremum, but does not preserve the 

infimum, i.e., Deg(P ® Q) <\ Deg(P) ® Deg{Q) for some P, 2 c N^. 

Corollary 162. SJ : Dl ^ D\ is left-adjoint to id : D{ ^ D^, and id o V : ^ is identity. 
Additionally, V '■ ^\ preserves the supremum, but does not preserve the infimum, i.e., SJiP®Q) <j 

V P © V Qfor some P,QQ N^. 

Proof. By Theorem 156 and 83. For the infimum, see the next proposition. □ 

To simpUfy our notations, in the next proposition, we use notations Pv^2 and PVoo2 instead of 
IP V 2]Ilcivi ^i^d |[P V 21q|_, respectively. However, keep in mind that these notations may be different 
from original meanings of and Voo when P and Q are not H^. 

Proposition 163. Let P and Q be subsets ofBaire space N^. 

(1) V(^©0=} VPv^ve-_ 

(2) Deg(P© e) = Deg(P) U Deg(e) =\ Deg(P)VeoDeg(e). 

But, there are subsets P and Q ofBaire space satisfying the following conditions. 

3. V(^ © 2) <I V V Qfor each n e N. 

4. D^(P©e) <| D^(P)v^Dii(e) 

Proof. (1) We first construct a computable function <1) which witnesses V(P © Q) <} V^^w V Q- 
0(0) = <). Fix o- - o- — {{i,m),U,n)) e (2 x (N U {'(i}))^^. If / - then set O(o-) = (D(o-)"(n). If 
/ j, then set <l>(cr) = 0(cr~)~(tj)~(7)~tail(pry(cr)). Note that <l>(g) contains only finitely many (J's for 
any g e \J P^co V 2' by the definition of v^^. Thus, for any g e S/ P'^oj V 2» we have tail(<l)(g)) = 
/~tail(pr,(g)) for some / < 2. Hence, <l)(g) e V(P © Q)- 

We next construct a computable function <1) witnessing \J{P ® Q) >\ SJ P^ojSI Q- Set 0(0) - 
{). Fix cr e (N U (tt))^^. If o" = cr {m,n) for some m,n e N and tail(cr;0) is defined, then 
O(o-) = O(cr~)"<(tail(o-;0),n)). If cr - cr for some / < 2 and n e M, then 0(cr) = 
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^(c )"((0, ft), (1, ft)' 0' '^))- Otherwise, put 0(a") = 0{cr ). Note that tail(g) converges for any g e 
VC/'eG), and hence, prtaii(j;0)(<l>te)) is total. Therefore, tail(g) = tail(g; 0)~tail(prtaii(g.0)(O(^))). 
Thus, 0(g) e V;Pv^ V Q- 

(2) Clearly Deg(P ® 2) = P U 2, and recall that P U Q =\ IP V Qf^^_ <\ IP V Q^l^_. On the other 
hand, Pv^Q c D^(P) u DTgiQ). 

(3) Let /o and /i be Turing incompatable elements of N^. Fix n eN. Assume that Vf/ol'^n Vf/il -} 
Vl/ol'^t; Vl/il holds via a computable function O. We first set = 0^ ©/o e Vf/ol^w Vl/i)- Then 
pro(<I)(^o)) is total, since pri{0{go)) e Vl/i) implies /o =r go >r <l>teo) >t f\ that contradicts our 
assumption. In particular, {^{go I s))o = for some 5 e N. Then we extend go I s to gi = (go t 

® /i) e Vl/olv.; V{/il- Note that gi =t fi. By the same argument, ((D(gi f 0)o = 1 for some 
t € M. Therefore, we can ensure mc{^{gi)) > 1. By iterating this procedure, we can easily see that 
mc(0(g„+i)) > n for some g„+i e \J{fo]v^ Vl/il- 

(4) Let /o and fi be Turing incompatable elements of N^. Fix n e N, and assume that the condition 
Deg({/o})v^Deg({/i)) <{ Deg({/o))VooDeg({/i)) holds via a computable function We first set go = 

(f(Bfoe D^(|/o))VeoDii({/i)). Then pri(Oteo)) is not total, since priCOfeo)) e Dii({/i)) implies 
fo =j go >T (^(go) fi that contradicts our assumption. In particular, (O(go t ■*o))o = for some 
So e N. Then we extend go \ s to gi = {go \ ® /i) e Deg({/o))VooDeg({/i)). By the same 

argument, (0(gi I s\))o = 1 for some > ^o- Therefore, we can ensure mc((l)(gi)) > 1. Assume that 
g2n+i and S2n+i have been already constructed, mc(0(g2n+i)) > 2n + I, proigin+i) is an initial segment 
of fo, pri(g2„+i) = /i, and (Ofen+i I ^2n+i))o = L Then we extend g2n+i \ S2„+i to g2n+2 ^ (go \ 
S2n+iyi0^ ® h), where proig2n+2)~h = fo- Again we have (<l>(g2«+2 T ^2n+2))o = for some S2n+2 > 
S2n+i, and mc(0(g2„+2)) > 2n + 2. We extend g2n+2 t ^2«+2 to g2«+3 = (go \ ^2»+2)~(l'^ © /i*), where 
pri{g2n+3)''h* = fy. We havc ((D(g2«+3 \ 52«+3))o = for some 52«+3 > 52n+2, and mc((D(g2«+3)) >2n + ?>. 
Finally, we set g = lJ„eN gn- We can easily see that pr,(g) = for each / < 2, and mc(0(g)) = oo. Hence, 
g e D^({/o})v«,D^({/i )), but <D(g) ^ D^({/o})v^Dii({/i }). □ 

5.2. Diagonally Noncomputable Functions. A total function / : N ^ N is a k-valued diagonally 
noncomputable function if f{n) < k for any n € N and f{e) + <l>e(e) whenever Oe(e) converges. Let 
DNRj^ denote the set of all ^-valued diagonally noncomputable functions. Jockusch [43] showed that 
every DNR^^ function computes a DNR2 function. However, he also noted that there is no uniformly 
computable algorithm finding a DNR2 function from any DNRyt function. 
Theorem 164 (Jockusch [43]). 

(1) DNR^t >[ DNRa+i /or an); it e N. 

(2) DNR2 ^H'^kforany keN. 

Proposition 165. 

(1) If a {\,oj)-degree of subsets o/N^ contains a (1, l)-degree hj of homogeneous sets, then h} 
is the greatest (1, \)-degree inside d^. 

(2) If an (< D, lydegree d^'^ o/Hj subsets of 2^ contains a (1, < oj)-degree h^^ of homogeneous Hj 
sets, then \\\^ is the least (1, < Li))-degree inside d"^^. 

(3) Every (< a>, \)-degree o/TTj subsets of 2^'^ contains at most one (1, l)-degree of homogeneous 
sets. 

Proof For the item 1, we can see that, for any P c and any closed set Q c N^, if P <^ 2 then there 
is a node cr such that Q n [fr] is nonempty and P <} 2 n [cr]. That is, o" is a locking sequence. If Q is 
homogeneous, then P <j 2=1 2 [o"]- The item 2 follows from Theorem 72. By combining the item 
1 and 2, we see that every {< od, l)-degree of Hj subsets of 2^ contains at most one (1, < a»)-degree of 
homogeneous H*? sets which contains at most (1, l)-degree of homogeneous Hj sets. □ 
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Corollary 166. DNR3 <<'^ DNR2, and DNR3 <l DNR2. 

Proof. By Jockusch [43], we have DNR3 <} DNR2. Thus, Proposition 165 imphes the desired condition. 

□ 

By analyzing Jockusch's proof [43] of the Muchnik equivalence of DNR2 and DNR/; for any k > 2, 
we can directly establish the (< oj, (x>)-equivalence of DNR2 and DNR/; for any k >2. However, one may 
find that Jockusch's proof [43] is essentially based on the l,^ law of excluded middle. Therefore, the fine 
analysis of this proof structure establishes the following theorem. 

Theorem 167. DNR^vDNRa. <} DNR ,,2 for any k. 

Proof. As Jockusch [43], fix a computable function z : — > N such that (^ziv,u)(z(v, u)) = (Ov(v), 
for any v, m e N. Note that every g e (k^)^ determines two functions go ^ and gi € k^^ such that 
g(n) = {gid{n),gi{n)) for any n e N. We define a uniform sequence {FvlveN^ ^ of computable functions 
as T,,{g;u) = giiziv,u)), and A(g;v) = goiziv,Uv)), where Uy = mm{u € N : gi(ziv,u)) = (D„(m) i). Fix 
g e DNRp. Since {gQ(z{v,u)),gi(z(v,u))) = g(z{v,u)) + ((Dv(v), either go(z(v, «)) t Ov(v) or 
gi(z(v, uj) + 0„(m) holds for any v, m e N. We consider the following sentence: 

(3v)(Vm) ((D„(m) i ^ gi(z(v,M)) + 0„(m)). 

Let e{g, V) denote the ITj sentence (Vm) (<D„(w) i g\{z{v, u)) <D„(m)). If 9{g, v) holds, then Yy{g; u) = 
giiziv, u)) + ^u{u) for any m e N. Hence, Ty{g) e DNR^;. If ->0{g, v) holds, then u^, is defined. Therefore, 
A(g;v) - go{z(v,Uy)) ii^ <l>v(v), since gi(z(v,Uv)) - 3>h,,("v)) i- Thus, A{g;v) is extendible to a function 
in DNRi. Consequently, DNRiTDNRjt <} DNR^t^ by Theorem 161 (2). 

To see DNRi:TDNRi: ^\ DNR^2, we note that DNRi-TDNRi is not tree-immune. By Cenzer-Kihara- 
Weber-Wu [19], DNR^-TDNRyt does not cup to the generalized separating class DNR^.2. □ 

Corollary 168. DNRjt =<'^ DNR2 /or any k>2. Indeed, for any keN, the direction DNR^. <<'^ DNR^2 
is witnessed by a team of a confident learner and a eventually-Popperian learner In particular, DNR^; =^ 
DNR2 /or anyk> 2. 

Proof. By Proposition 134, DNR^ <^'^ DNRi:TDNR/t is witnessed by a team of a confident learner and a 
eventually-Popperian learner. Thus, Theorem 167 implies the desired condition. □ 

Corollary 169. There is an (< cij,a))-degree which contains infinitely many (1, l)-degrees of homoge- 
neous Hj sets. 

Proof By Corollary 168, the (< <x>, w)-degree of DNR2 contains DNR^. for any ^ e N, while DNR^ ^} 
DNR/foryt 7t /. □ 

For a pointclass F in a space X, we say that SEL(F, X) holds for {a,P)-degrees if, for every F set 5 c X 
and for every nonempty Hj set Q c 2^, there exists a 11 ^ set P c 2^ such that P S U Q. Jockusch- 

Soare [44] indicates that SEL(n°, N^) holds for (oj, l)-degrees, and points out that SEL(n°, 2^) does not 
hold for (o), l)-degrees, since the set of all noncomputable elements in 2^ is 11^. Simpson's Embedding 
Lemma [62] determines the limit of SEL(F, X) for {a>, l)-degrees. 

Theorem 170 (Simpson [62]). SELCS'], N^) holds for {oj, \)-degrees. □ 
Theorem 171 (Simpson's Embedding Lemma for other degree structures). 

(1) SEL(Z2, 2^) does not hold for (< a>, \)-degrees. 

(2) SEL(S°, 2^) holds for {l,co)-degrees. 

(3) SEL(n°, 2^) does not hold for {l,oj)-degrees. 

(4) SEL(n°, N^) holds for (< w, cjj)-degrees. 

(5) SEL(Z°, 2^) does not hold for (< a>, a>)-degrees. 
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Proof. (1) For any n° set P c 2^, we note that P Q 2^ is. E°. By Theorem 117, there is no set 
2^^ which is (< od, l)-below \] P. In particular, there is no 11° set 2^ which is (< oj, l)-equivalent to 

(2) For a given ^2 set S c 2*^, there is a computable increasing sequence {P/lieN of IIj classes such 
that S = UfeN^i- We need to show U/eN^; ®,sn^'' ^^"^^^ ©(sn^' < (x»)-equivalent to the ITj 
class Pi- Then, it is easy to see Ur A' ^1 ®; A- For given / e U; A> from each initial segment 
f [ n, a. learner ^ guesses an index of a computable function <l>>p(/|-„)(g) = rg for the least number / 
such that / I n e Tp. but f [ n ^ Tp._^. For any / e [JiPi, for the least / such that f e Pi\ Pi-u 
lim„»P(/ t n) converges to an index of Oiim„«F(/r„)te) = i^g. Thus, %m„>P(/r«)te) e '~Pi- Consequently, 

(3) Fix any special 11^ set P c 2*^. By Jockusch-Soare [44], there is a noncomputable Ej set A c N 
such that P has no A-computable element. Then {A} c 2^ is a singleton, since A is Ej. Therefore, 
P © {A} is n°. It suffices to show that there is no 11° set g c 2^ such that Q =1 P 9 {A}. Assume that 
2 =^ P ® {A) is satisfied for some 11° set Q c 2^. Then Q must have an A-computable element a € Q. 
Fix a learner witnessing P ® {A} Q. Then, we have <l>iim„'P(Q'|-«)(a^) = 1~A, since P has no element 
computable in a <j A. We wait for 5 € N such that *F(q' \ t) = 4'(a [ s) for any t > s. Then, fixu > s 
with (^wicy[u){a r w; 0) i= 1. Consider the n° set Q* = {f e Qn[a t «] : (Vv > u) ^(/ [ v) = »P(/ [ u)}. 
Then, for any / e Q*, <^\im,^'{fu){f) = <^w{aiM)(f) must extends (1>. Thus, {rA| <} Q* via the 
computable function O^natu)- Since Q* is special 11° subset of 2^, this implies the computability of 
1~A which contradicts our choice of A. 

(4) Fix a n° set S c N^. As Simpson's proof, there is a n° set 5 c N'^ such that 5 =} S. We can find 
a n° set P c 5 t2 such that P <\ S U Q, and P is computably homeomorphic to a 11° set P c 2^. Since 
S ^Q<T ^^Q' we have S U Q =^'^ P. 

(5) For every n° set P c 2^^, the Turing upward closure Deg(P) = {g e 2^ : (3/ e P) f <t g\ of P is 
E°, and Deg(P) has the least (< oj, oj)-degree inside deg'j^(P). By Theorem 149, there is no 11° subset of 
2^ which is (< a>, oj)-equivalent to Deg(P). □ 

5.3. Weihrauch Degrees and Constructive Principles. We can also give a characterization of our 
nonuniformly computable functions in the context of the Weihrauch degrees which is a generalization 
of the Medvedev degrees. Then, our results could be translated into the results on the Weihrauch de- 
grees. A partial function P :C ^(N^) is called a multi-valued function. Then P is also written 
as P : =1 N^. One can think of each multi-valued function P as a collection {P(jc)}jtedom(P) of mass 
problems P(x) c N^, or a Uj-theorem (^x € dom(P))(3j) y e P{x). 

Definition 172 ([11, 13, 12, 14]). Let P :c ^ and g :c N*^ =^ be multi-valued partial 
functions. 

(1) A single- valued function q :C — > is said to be a realizer of Q if q(x) € Q{x) for any 
X e dom(2). 

(2) We say that P is Weihrauch reducible to Q (written P <vi/ Q) if there are partial computable 
functions H, K such that K{x, q o H{x)) for any x e dom(P) and any realizer q of Q. 

Remark. If we think of the values P(x) and Q(x) as relativized mass problems P'^ and Q^, then P <-w Q 
can be represented as the existence of partial computable functions <1), A :C satisfying : 

qMx) _^ px fQj. ^j^y ^ £ dom(2), where is the ;c-compu table function mapping y e to ^(x © y). 
For any subset P of Baire space N'^, we define i(P) : ^ N'^ by l{P)(x) = P for any x € N*^. Then, 
the map l provides an embedding of the Medvedev degrees into the Weihrauch degrees, i.e., P <} 2 if 
and only if i{P) <w l{Q). 

Definition 173 ([11, 13, 12, 14]). Let P, 2 :C =| be partial multi-valued functions. 
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(1) (Pairing) (P, Q){x) = P{x) x Q{x). 

(2) (Product) {P X Q){{x,y)) = P{x) x Q{y). 

(3) (Coproduct) (P U e)(0, X) = {0} x P(x); and (P U e)(l, x) - {1} x Qix). 

(4) (Composition) (P^o Q)(x) = [j{P(y) : j € Q(x)}. 

(5) (Parallelization) P((a;,- : / e N)) ^ n,eN^(^/)- 

Let X be a computable metric space (for definition, see Weihrauch [75]). Then, J?l_(X) denotes the 
hyperspace of closed subsets of X with the upper Fell representation ifr- (see [11]). For example, P is a 
computable point in the hyperspace J?l_(N^) (resp. ^_(2^)) if and only if P is a Hj subset of Baire space 
(resp. of Cantor space 2^). 

Definition 174 (Closed Choice [11, 13, 12, 14]). Let X be a computable metric space. Then, the closed 
choice operation of X is defined as the following partial function. 

Cx :c J?l_(X) ^ X, A A 

Here, dom(Cx) = (A e :?l_(X) : A ?t 0|. 

Remark. One may think of the closed choice of Cantor space as the following (relativizable) mass 
problem: Let {P^}eeii be a computable enumeration of all nonempty n'j'(.x) subsets of Cantor space 2*^, 
uniformly in x e N^. The V-player chooses some (e, x) e NxN^ which codes an instance of the problem 
C2N. Then the 3-player receives (e, x), and then she is required to solve the relativized mass problem P^ . 
The 3-player wins if she succeeds to choose an element of the e-th nj(x) set P^ c 2^, where she can 
use the information of the choice (e, x) of the V-player. Otherwise, the V-player wins. Intuitively, the 
Weihrauch degree of C2M is the degree of difficulty to computing a winning strategy for the 3-player. It is 
not hard to see that C2M =w C[oj] =w WKL, where WKL denotes the multi- valued function representing 
Weak Konig's Lemma. 

Definition 175. We introduce non-intuitinistic principles as the following partial multi- valued functions 
on Baire space. 

(1) (The law of excluded middle for 1,^ formulas) 

n . ^. . N n . ^. . fo. if (3« e N) p{n) - 0, 



1, otherwise. 



(2) (The law of excluded middle for A2 formulas) 



AHEM:cn2xN^^2, A°-LEM(/,;,p) - T' if^^^ot,' 

ll, otherwise. 

Here, dom(A^-LEM) = {(/, 7, ;?) £ x : Tot,- = N*^ \ Tot^}, where Tot,, denotes the set of all 
oracles a e such that n) converges for all inputs « € N. 

(3) (The lessor limited principle of omniscience for l}^ formulas) 

I^-LLPOtt :c (N^)'' =^ a, (x,);<,, ^ {i < a : (3'"n e N) x,(«) - 0}. 

Here, dom(E°-LLPO„) - {(x;),<a € (M^)" : (3/ < a){3'^n e N) Xi{n) - 0}. Define 2:°-LLP0 - 
X°-LLP02. 

(4) (The double negation elimination for 1^ formulas) 
E^-DNE :c N*^ =^ N, x 1-^ {m e N : (V« > m) x{n) + 0}. 



"2 



Here, dom(X*'-DNE) - |x € : (3m e N)(Vn > m) x{n) + 0). 
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(5) (The law of excluded middle for l.^ formulas) 

n r-. . N n . f(0, s), if (Vm e N)(3« > m) pin) = 0, 

^ ^ \{\,s), if {yn> s) p{n) + 0. 

(6) (The lessor limited principle of omniscience for (Ej A H^) formulas) 

(Z°)2-LLP0,, : {xi)i^a ^ {{i,m) : (3°°« e N) x,<«) - & (Vn > m) Xi{n) t 1}. 

Here, dom((X°)2-LLPO„) - {(x;);<„ G (N^)'^ : (3/ < a)[(3°°n € N) x,-(«) - & (-.3"'?2 e 
N) Xi{n) = 1]}. Define (X^)2-LLP0 - (X^)2-LLP02. 

(7) (The double negation elimination for 1,^ formulas) 

I°-DNE : X \^ {k : Q/m e N)(3n > m) x{{k,n)) = 0}. 
Here, dom(l"-DNE) - {x e : {3k e N)(Vm e N)(3?i > m) x{{k,n)) = 0}. 



Remark. (1) The single-valued function Ej-LEM is usually called the limited principle of omni- 
science (LPO). Brattka-de Brecht-Pauly [11] showed that a single-valued partial function / :C 
is (1, ai)-computable if and only if / is Weihrauch reducible to the closed choice Cn 
for the discrete space N. Here, in their term, the (1, 6(j)-computability is called the computability 
with finitely many mind changes. It is not hard to see that the closed choice Cn is Weihrauch 
equivalent to UmeN^?-'-^'^"'' "^^^^^ ' ^ *^ m-foU product of / : X =| 7. We 

also note that Ej-LEM'" is Weihrauch equivalent to the least number principle with the upper 
bound m + I, Xj-LNP^+i : m + I, which maps p to min({m} U {p(n) : n e N}). To see 

S^-LEM'" <w I°-LNP,„+i, we consider two computable functions H : (N^)"" ^ {m + 1)^ and 
K : (N^)™ X {m + I) ^ 2'" defined as //((a;,),<,„)(?i) = #{/ < m : (Vm < n) Xi{m) + 0| and 
Ki{xi)i<,„,k)(j) = min({l} U {xj{m) : m < s^}), where s^ = min{s e N : H{{xi}i<,„){s) = k}, and 
another direction is trivial. 

(2) E2"'-LP02 is Weihrauch equivalent to the jump LLPO' o/LLPO in the sense of Brattka-Gherardi- 
Marcone [14]. They also showed that LLPO' is Weihrauch equivalent to the Borzano-Weierstrass 
Theorem BWT2 for the discrete space {0, 1). We also note that ll^-LLPOk is equivalent to the In- 
finite Pigeonhole Principle for /:-partitions. Brattka-Gherardi-Marcone [14] also pointed out that 
the n-th jump of LLPO and LPO correspond to Sj|^j-LLPO (that is, the lessor limited principle of 
omniscience for Sjj^j -formulas) and Sj|^j-LEM (the law of excluded middle for -formulas), 
respectively. 

(3) The Dirichlet function 1q : R — > {0, 1), the characteristic function of the rational numbers Q, 
is Weihrauch reducible to Ej-LEM. Indeed, it is easy to see that the Dirichlet function 1q is 
Weihrauch equivalent to the single-valued function II^-LEM : 2, where n2-LEM(;?) = 0, 
if p(n) = for infinitely many n eN; and Il^-LEM(p) = 1, otherwise. It is well-known that the 
Dirichlet function 1q is of Baire class 2, but not of Baire class 1 (i.e., 1q is H^-measurable but 
not i;2"mc^surable). 

(4) The study of arithmetical hierarchy of semiclassical principles such as E|]-LEM, E|]-LLP0, and 
E^-DNE was initiated by Akama-Berardi-Hayashi-Kohlenbach [1]. In particular, on the study of 
the second level of arithmetical hierarhcy for semiclassical principles, see also Berardi [4] and 
Toftdal [72]. The relationship between the learnability and E^-DNE has been also studied by 
Nakata-Hayashi [54] in the context of a realizability interpretation of limit computable mathe- 
matics. 



Definition 176 (Unique variant [14]). LetP : X ^ 7 be a multi-valued function. Then UniqueP : X ^ Y 

is defined as the restriction of P up to dom(UniqueP) = {x e dom{P) : #P{x) =1). 
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Proposition 177. Aj-LEM is Weihrauch reducible to UniqueXj-LLPO. 

Proof. To see A°-LEM <w UniqueI°-LLPO, given {e(),ey,p) € x N*^, define H{eo,ei,p) to be a 
pair {xo,xi), where Xi(s) = if and only if the computation Oe-^s+\ip) at stage s + I properly extends 
^ei,s{p) at the previous stage. Then xi contains infinitely many O's if and only if p is contained in Tot^,. 
Note that, whenever (eo,ei,p) is contained in the domain of A2-LEM, H(eo,e\,p) is also contained in 
the domain of UniqueE°-LLPO, since Totg^ = \ Tot^,. Therefore, UniqueZ^-LLPO o H{eo,ei,p) = 
A°-LEM(eo,ei,;7). □ 

Theorem 178. Let f :C — > be a single-valued partial function. 

(1) / is {l,m + \)-computable if and only if f <vi/ Sj-LEM'". 

(2) / is (1, a>\m)-computable if and only iff <w UniqijeX2-LLP0„,. 

(3) / is {\,oj)-computable if and only if f <w X2-DNE (equivalently, f <iy Ej-LEM"', or 
equivalently f <-w UmeN Uniquel2-LLP0,„j. 

Proof. (1) Assume that / is (1, m)-computable via a learner *F. We need to construct partial computable 
functions K -.qW* xm ^ and // :C ^ {M^f such that f{x) = Kix,lP^-LEM'" o H{x)) for 
any x e dom(/). Fix x e N^, we uniformly construct H{x) = {Hi{x))i<,„ as follows. We first set 
Hi(x; 0) = 1 for each / < m. Assume that Hi(x; k) has been already defined for any k <l and each / < m. 
If "^{x r / + 1) - "PCx r 0, then we set Hi{x; / + 1) = 1 for each / < m. If 'V{x\l+\)i^ "^{x \ I), then let 
i{l + 1) be the maximal j < m such that Hj{x; k) = I for any k < I. Then, we define Hj(i^\){x; / + 1) = 0, 
and, for other / j{l + 1), put Hi{x; I + 1). Clearly, H : x {Hi(x)}i<,„ is computable. Assume that 
I°-LEM'" o Hix) = o-^ G l"". Let c(x) be the least u such that o-\u) = 1. Then #[nen:'¥{x [ n + I) i= 
^'{x I n)} = c(x). We define a partial computable function K : N'* x m — > as follows. For given 
{x, c) € X m, we wait for l{x, c) e N such that #{n < l(x, c) : "Vix [ n + I) i= ^'{x [ n)} = c. Then we 
set K{x,c) = Ovj/(/(v_c))(x). It is easy to see that K{x,c(x)) = Oiim„Wix\n)(x) = f{x) for any x e dom(/). 

Assume that / <iy Ij-LEM"' via partial computable functions K -.Q^^ xm ^ and // :C ^ 
(N^)'". Let us consider a partial computable function if/ : N^*^ — > N^^ defined by i/'(o") - K{o-,c{cr)), 
where c{o-,i) = if Hi{o-,n) = for some n < |//,(cr)|; and c{o",i) - 1 otherwise. Here, //(cr) = 
{Hi{cr)}j^,„. Note that c(o"; /) > c(t; /) for each / < m whenever cr c t. Thus, #{n e N : c(n + 1) 7^ c{n)] < 
m. Hence, #{n e N : tlf{x I n + I) il/{x \ n)] < m + \. Clearly, we have \fj{x) - lim„(A(;c \ n) = 
K(x,\im„ c{x [ n)) = f{x) for any x € dom(/), since Iim„c(;c [ n) converges to Ej-LEM™ o H{x). By 
modifying the proof of Proposition 42, we can see that f - i?, {\,m + l)-computable. 

(2) Assume that / is (1, 6(j|m)-computable via a learner ^. We need to construct partial computable 
functions ^ :C x m ^ and // :C ^ (N*^)'" such that f{x) = K{x, U o H{x)) for any 
X € dom(/) and any U which realizes Z^-LLPO,,,. We inductively construct H{x) = {Hi{x)}i^,n as 
follows. We first declare that is assigned to ^(O), and put Ho{{}) = (0) and //;(()) - (1) for any 
/ 0. Assume that Hi{cr~) has been already defined for each / < m. If ^{cr) ^ {^(r) : t c cr], 
then we declare that k is assigned to Y(o"), where k is the least number which has not been assigned 
to any index e e {^(t) : t c cr). Then, put Hk{cr) = Hk{cr-y{0), and Hi{cr) = //,(o"")~<l) for other 
/ + k. If ^(o") ^ |*P(t) : T c cr), then some k must have been assigned to 0(o"). For such k, we put 
//^(cr) = Hkio-'TiO), and = Hi{o-~)'{\) for other / k. Clearly, H : x <U«eN^K-^ t «)>i<m is 

computable. If ;c e dom(/), then there is a unique / < m such that Hi{x; n) - for infinitely many n £ N, 
since lim„^(;c \ n) converges. Let U{x) denote the unique element of UniqijeZ2-LLP0mW, for any 
X e dom(UniqueX2-LLPO„,)- Note that U o H{x) is assigned to some ^(x \ s{x)) along the construction 
of H{x), for any x e dom(/). Fix the least such s{x) e N. It is easy to see that lim„ ^(x I n) converges 
to ^(x \ s{x)). We set K{x,u) - ^^'(x\t(x,u)){^), where t{x,u) is the least t such that u is assigned to 
^(x \ t) along the construction of H{x). Then, K : x m — > is computable. Moreover, we have 

K{X, U o H{x)) = (^Wixtsix))(.x) = Olim„Wixtn){x) = /(x). 
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Assume that / <-w UniqueX^-LLPO'" via partial computable functions ^ :C N x m ^ N and H :C 
(N^)'". Let Ci be an index of Ax.K{x, i) for each / < m. We first compute h(cr, i) = #{n < |//,(o")l : 
Hi{o", n) = 0], where H{cr) = {Hi{o-))i<m- Then let c(cr) be the least / < m such that h{(T, k) < h{cr, i) for 
any k < m. Let us consider a learner : N^^ — > {e,),<m defined by ^(cr) = ec{o-)- For any x € dom(/), we 
have H{x) e dom(Uniqije22-LLPO'"), and then lim„ h{x I n, i) = oo for just one / < m. Then, lim„ c(x I 
n) also converges to such / < m. Moreover, for any x € dom(/), UniqijeE2-LLP0'"(//(A;)) = {/) if and only 
if lim„/z(;c \ n,i) - oo. We fix a reaUzer U of Uniquel^-LLPO"', i.e., U{x) e UniqueS°-LLPO'"(;c) for 
any x e domCUniqueXj-LLPO'")- Then, lim„ c{x \ n) = U oH{x) for any x e dom(/) Therefore, the limit 
lim„*P(jc \ n) converges to euoH(x), and #{^'{x |~ «) : « e N) < : i < m] < m. Thus, ^iim„^ix[n)ix) = 
^euoH^i^y - ^(■^' ^ ° H{x)) = f(x) for any x e dom(/). Hence, / is (1, tL»|m)-computable. 

(3) Clearly, E2-DNE is Weihrauch equivalent to the closed choice Cn for discrete space N. Therefore, 
the desired condition follows from Brattka-Brecht-Pauly [11]. The equivalence with / <w UmeN^i" 
LEM"', and / <w UmeN Uniquel^-LLPOm is easily shown by the same argument as the proofs of (1) and 
(2). □ 

Theorem 179. Let P be any subset o/N^, and Q be a A^' subset ofM^. Then, f : Q ^ Pfor a (1, w|m)- 
computable function ifff : Q — > Pfor a single-valued function f <w A^-LEM'" for some m e N. 

Proof. By Theorem 156 (2). □ 

Theorem 180. Let PbeaU° subset o/N^, and Q be any subset o/N . 

(1) P <^'^ Q ifff : Q P for a single-valued function f <w X^-LLPO^ /or some m e 

(2) P <^'^ Qijff-Q^ P for a single-valued function f <w (X°)2-LLP0„, /or some mew. 

(3) P <^ Q iff f '■ 2 — > P for a single-valued function f <-w E^-DNE (equivalently, f <w 
S«-LLPO^j. 

Proof. (1) Assume that P <^'^ Q via a collection {Oe}e<fo of partial computable functions. It suffices to 
show that f : Q P for some / <w Ej-LLPOfo. Note that the condition <I>e(x) is total and belongs to 
P is uniformly in e < b and x e N^. Thus, there is a computable function // : ^ (N^)'' with 
H{x) = {He{x))e<h satisfying that He{x; n) - for infinitely many « e N if and only if (te{x) is total and 
belongs to P. By our assumption, there i?, e <b such that He{x; «) = for infinitely many n £ N, for any 
xeQ. Therefore, H{x) £ dom(X°-LLPOfo) for any x e Q, and, for any realizer G of S^-LLPOfo, G o H{x) 
chooses e < b such that Og(;c) £ P. Then, for a computable function K : x Z; — > mapping (x, e) to 
0^(x), we have K{x, G o H{x)) = Oe(x) £ P. 

If / • 2 — > -P for a single-valued function / <]y S^'LLPO,,,, for some m £ N, then there are computable 
functions // : ^ (N^)"' and i*: : x m ^ such that K{x,G o H{x)) £ P for any realizer G 
of S°-LLPO„ and any element x £ Q. Then K{x, i) e P for some / < m, since G o H{x) < m. Set 
(l)e(;)(x) = K(x, i) for each / < m. Then P <^'^ Q via {<^e{i)}i<m- 

(2) Assume that P Q via a team {^i}e<b of learners. It suffices to show that / : 2 — > P for some 
/ <w (2^2-'2-LLPOfo. The condition Rii,x) stating that lim„^;(x \ n) converges and <I>iim„'P,(.vi-n)W is 
total and belongs to P is (112)2, uniformly in / < Z; and x e N^. Thus, there is a computable function 
// : f^N ^ (NN^fo ^jjj^ ^(-^^ ^ (//,(x)),<fo satisfying that Hi{x; n) + 1 for any « > m if and only if 
^(x \ n) = '^{x \ m) for any n > m, and that Hi(x; n) = for infinitely many « £ N if and only if 
^iim„>p,(.vi-n)(^) is total and belongs to P, whenever lim„^,(x \ n) converges. By our assumption, R{i,x) 
holds for some i < b, for any x £ Q. Therefore, H{x) £ dom((I°)2-LLPO/,) for any x e Q, and, 
for any realizer G of (E2)2-LLPOfo, G o H(x) chooses / < b and m e N such that (l>>F,(A|-m+i)W £ P- 
Then, for a computable function K : x x N — > mapping {x,i,m) to <l>>F,(.Y|^m+i)(x), we have 
K{x, G o H{x)) = (^e{x) £ P. 
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If / • 2 — > -P for a single-valued function / <^ (E2)2-LLPO,„, for some m e N, then there are 
computable functions // : ^ (N^)'" and : x m x N ^ such that K{x, G o H{x)) e P for any 
reaUzer G of (E2)2-LLPO„, and any element x e Q. Then there is / < m such that K{x, i, k) e P for any 
k with Hi(x;n) + 1 for any n > k, where H{x) = {Hi{x)}j<,„. Let e{i,k) be an index of the computable 
function Ax.K{x, i, k), for each / < m and ^ e N. The learner A,(;c t 0) first guesses e(i, 0). Assume that 
Aj(x r n) has been already defined. If Hi{x; n) = 1, then we set A,(;c [ n + l) = e{i, n + 1). If //,(x; n) t I, 
then we set A,(x [ n + 1) = A,(x t i)- Then, there is a realizer G of (E2)2-l-LPO,„ such that, for any 
X € Q, <l>iim„ A;(.vi-n)(-''^) = K{x,G o H{x)) € P foi somc / < m. Hence, P <^ Q via a team |A,j,<„, of 
learners. 

(3) Assume that P <^ Q. It suffices to show that / : 2 ^ P for some / <w i:3-DNE. Note that 
the condition O^Cx) is total and belongs to P is 112, uniformly in e e N and x e N^. Thus, there is a 
computable function H : — > satisfying that H{x; e, n) - for infinitely many « e N if and only if 
Oe(x) is total and belongs to P. By our assumption, there is e e N such that H{x; e,n) = for infinitely 
many « e N, for any x e Q. Therefore, H(x) e dom(E^-DNE) for any x e Q, and, for any realizer G of 
i:°-DNE, Go//(x) chooses e <b such that Og(x) e P. Then, for a computable function /<: : N^xN ^ 
mapping (x, e) to ^e(x), we have K{x, G o H(x)) = <l>e(x) € P. 

If / • G ~* P for a single-valued function / <w S^-DNE, then there are computable functions 
// : ^ N*^ and Ti: : X N ^ such that K{x, G o H{x)) e P for any realizer G of I^-DNE and 
any element x € Q. Then K{x, i) € P for some / e N, since G o H{x) < m. Set (l)e(,)(x) = K{x, i) for each 
i e N. Then P Q via {Oe{i)hen- □ 

Theorem 181, Let P and Q be any subsets o/N^. Then, PJ°P <} Q if and only if f : Q ^ P for a 
single-valued function f <w X2-LEM. 

Proof Assume that there are two computable functions // : N'^ ^ and ii: : x 2 x N ^ 
such that K{x, G o H{x)) e P for any x g 2 and any realizer G : ^ 2 x N of E^'-LEM. Then the 
sentence (3v)6(v, x) is given by (3v)Q/n > v)H{x; n) 0. We also define A(x) = K{x, (0, 0)), and rv(x) = 
K{x,{\,v)), for any x e N^. Fix x e Q. If 9{v, x) is true, then there is a realizer G of Zj-LEM mapping 
Hix) to (l,v). Therefore, r„(x) - Kix,{l,v}) = K{x,G o H{x)) e P. If (Vv)-.0(v, x) is true, then there 
is a reahzer G of S°-LEM mapping H{x) to (0, 0). Therefore, A(x) ^ K{x, <0, 0)) ^ K{x, G o Hix)) e P. 
Hence, by Theorem 161, we obtain PJ°P <} Q. 

Conversely, we assume that Pt°P <} Q. Then, there are computable collection A, |r,,)vg of com- 
putable functions, and a l,^ sentence 3vO(v,x), as in Theorem 161. By analyzing the proof of Theorem 
161, we may assume that this Z2 sentence has an additional property that, if 9{v, x) is true and v < u, then 
0(u,x) is also true. For any x e N^, put K{x,{0,n)) = A(x) for each « e N, and K{x,{l,v)) = r^,{x). 
From the l!^ sentence 3v9{v, x), we can easily construct a computable function H : satisfying 
that 0{v, x) is true if and only if H{x; n) for any n > v. Fix x e 2 If 3v9(v, x) is true, then any 
realizer G of E2-LEM mapping H{x) to some (1, v) witnessing 9{v, x). Then, K{x, G o H{x)) = Ty.(x) e P. 
If ^v-'9{v, x) is true, then any realizer G of S2-LEM mapping H{x) to (0, s) for some 5 e N. Then, 
K{x, G o H{x)) = A(x) e P. □ 

Definition 182. Let :C =^ be a partial multi- valued function. A partial single-valued function 
/ :C — > is Q-computable if / is Weihrauch reducible to 0. By £9, we denote the least class 
containing all 0-computable functions and closed under composition. Then, for subsets P, Q of N^, we 
write P <0 2 if / : 2 ^ P for some / e £9. If Cq is the class of all computable homeomorphisms 
between subsets of N^, then <0 is also denoted by <. If Cq is the class of all partial computable functions 
on N'*, then <0 is also denoted by <j;0-dnE' i-^-' -x''-DNE--r 

Corollary 183. Let X, Y be subsets ofW'\ P be ali\ subset o/N^, and D be a A^' subset of'H^\ 
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X^-LEM T° 

X«-LLp6^ ^Z«-DNE [Kr]?^ ^^^r]! 

A°-LEM "^[^rlL^ 



Figure 5. Constructive principles, and nonuniform computability. 

(1) Y <i ^ X if and only if Y <^o.lem X. 

<^2) Y <l^^^ X if and only ifY <uniquezO-LLPO ^■ 

Y -l\<oj ^ '^^"^ ^'^'y ^UniqueE«-LLPO ^ 'f'"^^ only ifY <a0.lem ^■ 

(4) Y <lX if and only ifY <j;o.dne ^■ 

(5) P <^'^ X if and only ifP <5;0_llpo ^■ 

(6) FT°y <} X if and only ifY <jo.^^^ X. 

(7) P <r X if and only ifP <(5;0),1lpo ^■ 

(8) P <^ X j/ W on/}; ifP <5;o_DNE ^■ 

Proo/ By Theorem 178, 179, 180, and 181. □ 

Theorem 184. The symbols P, Q, and R range over all special IT j subset of T^, and X ranges over all 
subsets ofM^. 

(1) For every P, there exists Q < P such that P <j;0-lem 2. whereas, for every X, ifP <j;0-dne G ® ^ 
then P <xO-DNE ^• 

(2) There are P and Q < P such that P </^o_y_^f^ Q but P ^x^-LEM Q- 

(3) There are P and Q < P such that P <j;''-llpo Q ^ ^a^-lem Q- 

(4) There is P such that, for every Q, ifP <5;o_|_|_po Q, then P <j;o_|_em Q- 

(5) For every P and R, there exists Q < P such that P <x'''-DNE Q ^ ^s^-LLPO Q- 

(6) For every P, there exists Q < P such that P <5;''-lem Q' whereas, for every X, ifP <j;''-dne G ® ^ 
then P <xo.DNE ^■ 

(7) For every P and R, there exists Q < P such that P <-£o_Qf^^ Q but R ^(5;0)^_|_|_pQ Q. 

Proof Item 1. By Corollary 88 and 183 (1). Item 2. By Corollary 59 (2) and 183 (1,3). Item 3. By 
Corollary 61 (1) and 183 (3,5). Item 4. By Theorem 72, and Corollary 183 (1,5). Item 5. By Corollary 
118 (2) and 183 (4,5). Item 6. By Corollary 129 and 183 (4,6). Item 7. By Theorem 149, and Corollary 
183 (7,8). □ 

5.4. Duality between Dynamic Operations and Nonconstructive Principles. 

Definition 185 (Brattka-Pauly-le Roux [16]). For any multi-valued functions F,G :C N'^ =| N^, the 

perfect information composition F -k G .Q =| of F and G is defined as follows. 

F -kG : {eYx ^ {x®y®z:y e G{x) & z e F o (D,.(y)}. 
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Theorem 186 (Brattka-Pauly-le Roux [16]). Let F,G :C N =| N be any multi-valued functions. Then, 
F -k G = m&x<^[F* o G* : F* <w F 8l G* <w G}. □ 

If multi- valued functions C, D :C =| satisfy the condition 

DoE<wF E <w C * F 

for any multi-valued functions E, F :C =^ N'*', then we may think of D as the inverse of C. One could 
think of our disjunction operators as inverse operators of various constructive principles. 

Definition 187. Fix x e N^. 

(1) v(x) = {3; e (N U {(tl)^ : #{« e N : y{n) = jj} < 1 & tailC);) = x]. 

(2) v^(x) = {ye{2x Mf : (B/ < 2) pr^O;) - x & mcO;) < 00}. 

(3) y^(x) - G (2 X N)N : (3/ < 2) pr,-0;) - x}. 

(4) degr(x) = {y € : X <r y}. 

A multi- valued function P :C ^ is Popperian if there is a computable function r :C N^xN^ ^ 
satisfying Ej-LEM o r{x,y) = \p(x){y), for any x e dom(P) and y 6 N^, where \p(x) denotes the 
characteristic function of P(x). In other words, P is Popperian if and only if the condition y e P(x) is 
Hp uniformly in x 6 dom(P) and y e N'*. Every Popperian multi-valued function is cleai^ly Weihrauch 
reducible to the closed choice C^n of B aire space N^. 

Proposition 188. Let E, F : =^ N'^ be any multi-valued functions. 

(1) v<"> oE <w F if and only ifE <w I°-LEM" ★ F. 

(2) v^'^ oE <w F if and only ifE <w UniqueI^-LLPO„ ★ F. 

(3) ^ oE <w F if and only ifE <w S°-DNE ★ F, where V = IJneN 
Moreover, ifE is Popperian, then we also have the following conditions. 

4. v^^ oE <w F if and only ifE <w 2:^-LLP0„ ★ 7^. 

5. v^^^ ow oE <w F if and only ifE <w (2:°)2-LLPO„ ★ F. 

6. degY o E <w F if and only ifE <w X^-DNE ★ F. 

Proof (1) Assume that there are partial computable functions // :C ^ and :C x ^ 
such that K{x, f o H{x)) e v*^"^ o E{x) for any x e dom(v^"^ o E) and any realizer / of F. Then, for any 
realizer / of F, we have the following condition for any x e dom(£'). 

Ko{idxf)o (id, H}{x) = K{x, f o H{x)) e v^''^ o E{x) = \JIe{x). 

Note that H* = (id, //) : N*^ ^ N'*^ x is computable, F* = 7*: o (id x F) : x ^ 
is Weihrauch reducible to F. As in the proof of Theorem 156, we can construct an (1, ?i)-computable 
function y : Vn ^i^) ~^ E{x), uniformly in x e dom(£'). Therefore, by Theorem 178, we have a 
function y <w Sj-LCM" satisfying y o /* o H*{x) e E{x) for any x e dom(£') and any realizer /* of F*. 
Consequently, E <w I'l'-LEM" ★ F. 

Conversely, we assume that E <w S* o F* for some S* <w Xj-LEM" and F* <w F. Then there 
are computable functions H*,K* such that K*(x,H* o /(x)) e F*(x) for any realizer / of F. From any 
single valued function / : — > N'^, we can effectively obtain /*(x) = K*{x,H* o /(x)). Assume that 
S * <w X'j'-LEM" via H and K, and E <wS* o F* via H and K. We consider ///(x) = H o f* o H{x) and 
Kf{x, i) = K{x, K{f* o H{x), /)) Then, we have the following condition for any x e dom(£'). 

Kf{x, E'i'-LCM" o Hfix))) e E{x). 

By calculating Hf{x) = H o f* o H{x), we can approximate /(/; x) = E^-LEM" o Hf(x) uniformly 
in /. Therefore, we can construct Fj. to show v^"^ o E <w F by the following way. Set FjiO) = 0, 
fix cr € N^^, and assume that FUcr^) has been already defined. If i{f;cr) + i{f;cr^), we put Ft(cr) = 
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^^(c )~'^~Kf(cr, i{f; cr)). Otherwise, continues the approximation of Kf(cr, i(f; cr)). It is not hard to 
see that F'^{x) e v*-"^ oE(x) for any x e dom(£') and any realizer / of F. Then, is Weihrauch reducible 
to {Kf,Hf}, and {Kf,Hf) is Weihi^auch reducible to /. Moreover, these reduction are not depend on /. 
Hence, v^") oE <w F. 

(2,3) By the same argument as in the proof of the item (1). 

(4) Assume that E :C =^ is Popperian, and there are partial computable functions H :C — > 
and /«: :C x N*^ ^ such that K{x,f o H{x)) € o E{x) for any x € dom(vS' o E) and any 
realizer / of F. Then, for any realizer / of F, we have the following condition for any x e domCF). 

^ o (id X /) o {iA,H){x) = K(x,f o H{x)) e o E{x) = [SJJlEix). 

As in the proof of Theorem 156, we can construct an (n, l)-computable function y : [V],, E{x) — > E{x), 
uniformly in ;c e dom(£'). Here, note that E{x) is a H^ix) subset of Cantor space, uniformly in x. 
Therefore, by relativizing Theorem 180, we have a function y <w S^-LLPO" satisfying y o (id x /) o 
(id, H){x) e E{x) for any x e dom(£') and any realizer / of F. Consequently, E <vi/ X^-LLPO" ★ F. 

(5,6) By the same argument as in the proof of the item (4). □ 

Definition 189. The lessor limited principle of omniscience with (m/k) wrong answers, E^-LLPOmz/t, 
is the following multi-valued function. 

2:°-LLP0,„/^ :c =^ it, x {I < k : {\/n e N) x{kn + /) - 0}. 

Here, dom(E'j'-LLPO„,/A:) ^ {x e : x{n) i= 0, for at most m many n e N). 

Remark. It is well-known that the parallehzation of Sj-LLPOi/2 is equivalent to Weak Konig's Lemma, 
WKL (hence, is Weihrauch equivalent to the closed choice for Cantor space, C2h)- 
Definition 190. 

(1) (Cenzer-Hinman [21]) A set P c is {m,k)-separating if P = rineN^n for some uniform 
sequence {P„)„eN of sets F„ c k, where #{k \Fn) <m for any « e N. 

(2) A function / : N'" — > ^ is k-valued m-diagonally noncomputable in a € if the value 
f{{eQ, e„,-i )) does not belong to {<I>e.('3'; (^o, ■ ■ ■ , ^m-i )) : ' < "i) for each {eo, - - - , em-i ) e N™. 
By DNR„,/jt(a), we denote the set of all ^-valued functions which are m-diagonally noncom- 
putable in a. 

(3) The (m/k) diagonally noncomputable operation DHHmik '■ =1 is the multi-valued function 
mapping a e to DNR„,/<-(a). 

Remark. Clearly DNRm/^(0) is (m, ^)-separating. The Medvedev degree structure of (m, /:)-separating 
sets have been studied by Cenzer-Hinman [21]. Diagonally noncomputable functions are extensively 
studied in connection with effective randomness, for example, see Greenberg-Miller [34]. 

Proposition 191. DNR„,/jt is Weihrauch equivalent to Zj-LLPOm/i. 

Proof. To see Zj-LLPO„,/i: <-w DNR„,/^, for given {xi : / e N), let e\ be an ^.gjj;c,-computable index 
of an algorithm, for any argument, which returns I at stage s if I e Lg+i \ and #Ls - t, where 
Ls = {I* < k : (3n) kn + I* < s & Xi{kn + I*) i= 0). Clearly, {e\ : i e M & t < m] is computable 
uniformly in 0,gN^,-. For any / £ DNR„/,t(0^.gj^ x,), the function / i-^ f{{e[y...,e\^^_^)) belongs to 

jP^-\±PO,nik{{xi : / e N». Conversely, for given x e N^, for the i-th m-tuple {cq, . . . ,e,n-i} e N'", 
we set Xj{ks + I) = 1 if <l>g,((eo> ■ ■ ■ >^m-i)) converges to / < ^ at stage 5' e N for some t < m, and 
otherwise we set Xi{ks + I) = 0. Clearly {xj : / e N) is uniformly computable in x. Then, for any 

{li : / e N) e iP^-lLPOm/kiixi : / e N)) c k^, we have ^ {^^M^o, . . . ,e,„^i)) : t < m] by our 
construction. Hence, the ^-valued function / 1-> /, is m-diagonally noncomputable in x. □ 

Corollary 192. Let k >2 be any natural number 
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(1) I?-LLPO,/, lO-DNE * lO-LLPOi/,+1. 

(2) I?-LLPbi/, 2:°-LLP0 ★ S<'-LLPOi/,+i. 

(3) S?-LLPbi/, <w XO-LEM ★ EO-LLPOi/,+i. 

Proof. By Corollary 166, Theorem 178, Theorem 180, and Proposition 191, the item (1) and (2) are 
satisfied. It is not hard to show the item (3) by analyzing Theorem 167 and Theorem 181. □ 

Remark. By combining the results from Cenzer-Hinman [21] and our previous results, we can actually 
show the following. 

(1) S°-LLPO„// * I°-LLPb„/i, whenever < « < / < \klm\ 

(2) E^-LLPO„/; 2^-LLPO ★ S'/-LLPb,„//t, whenever < «< Z < \klm\ 

(3) S^-LLPO„// <w S2-LEM * 2:°-LLPb,„/i:, whenever < « < Z and < m < yt. 

These results suggest, within some constructive setting, that the "L^ law of excluded middle is sufficient 

to show the formula Sj-LLPOhj/j^ — > Sj-LLPO,,//, whereas neither the double negation elimination nor 
the ^2 lessor limited principle of omniscience is sufficient. 

Corollary 193. DNR2 <j;0-lem DNR3; DNR2 ^x?-llpo DNR3; DNR2 ^^o.^^e DNR3; MLR <j;o_lem 
DNR3; and MLR ^5;o.|-)ngE DNR3. Here, recall that MLR denotes the set of all Martin-Lof random reals. 

Proof. For the first three statements, see Corollary 166, and Theorem 167, 178, 180. It is easy to see 
that MLR <} DNR2 <5;o.LEM DNR3. It is shown by Downey-Greenberg-Jockusch-Millans [28] that 

MLR ^} DNR3. By homogeneity of DNR3 and Proposition 165, we have MLR ^^o.^^e DNR3. □ 

5.5. Some Intermediate Lattices are Not Brouwerian. Recall from Medvedev's Theorem 3, Much- 
nik's Theorem 5, and Proposition 41, the degree structures D\, D^, and D'^ are Browerian. Indeed, we 
have already observed that one can generate from a logical principle so called the "L^-double negation 
elimination. Though £)<^, "D]^^^^ and D^*^ are also generated from certain logical principles over !D\ as 
seen before, surprisingly, these degree structures are not Brouwerian. 

Theorem 194. The desree structures Dl, D\ , Df'^, Pi, „ , , and P'f'^ are not Brouwerian. 

Put J?l(P, Q) = {R Q : Q <l,^ P ® R], and S(P, 2) = {/? c : Q <<^ P ® R]. Note that 
■^{P, Q) £ S(P> Q)- Then we show the following lemma. 

Lemma 195. There are 11^ sets P,Q Q 2^, and a collection {Z^leeN 0/ 11^ subsets of 2^ such that 
Zg £ :^{P, Q), and that, for every R € SiP, Q), we have R ^'^ Z^for some e eN. 

Proof. By Jockusch-Soare's theorem 69, we have a collection {5,},gN of nonempty 11^ subsets of 2^ such 
that Xyt ©y^tyt foi' ^'^y choice x; e Si, i e N. Consider the following sets. 

P = CPfK~ {S (efl)^ S (e,\)~ ■ ■ ■ ~S {e,e)]ee'N, Zg = S (e,e+l}, 

S (ej) ® Zg, if / < e, 

(P\[jO,])®Z„ ifi = e + l, 
0, otherwise. 



Q ^ CPA'{Qn}nen, where Quj) = 



Here, is the e-th leaf of the corresponding computable tree Pcpa for CPA. To see Z^ e ^(P, Q), choose 
an element f ® g e P <S> Z^. If f I n e Pcpa or / [ n extends a leaf except pe, our leai^ner t n) ® g) 
guesses an index of the identity function. If f I n extends p^, then ^ first guesses 3)'F((/|-«)eg)(/ ® = 
(/"~^''')©g. By continuing this guessing procedure, if / \ n is of the form pe~T^~T^ ~ . . .~t'~t such that t-' 
is a leaf of S (ej) for each j < i, and t does not extend a leaf of S (ej+i), then ^ guesses O>p((j[-„)0^)(/®g) = 
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(/-(b.l+|r l+-+|r'|)) ^ g_ Note that / < e, since / e P. It is easy to see that Q P ®Ze via the learner *F, 
where e N : ^((/ © 5) T « + 1) "PCC/ ® g) t «)l < + 1- Therefore, Z, £ :R{P, Q). 

Fix /? e S{P, Q). As 2 <^'^ P ®R, there is e N such that, for every f ® g e P ®R,sNt must have 
^e{f ® g) ^ Q for some e < b. Suppose for the sake of contradiction that R <'^ Zh+i. Then, for any 
h £ Zh+i, we have g e R with g <t h. Pick /o e pfo+i~S(fo+i^o> c P n [p^+i]. Since 7? 6 S{P, Q), there is 
eo < b such that <I>eo(/o ®g)eQ. By our choice of {^hIhsn and the property g <t h € Zb+i = S(h+i,h+2), 
if e i= b + I or i 0, then Q(ej) has no (/o ® g)-computable element. Therefore, (^eoifo © g) have to 
extend Take an initial segment ctq c /q determining <l>eo(cro ® g) 2 P(fo+i,o>- Extend ctq to a leaf 

r" of 5/,+i_o, and choose fi e p'T^'S/^+i^i c P. Again we have ei < b such that <l>ei(/i ® g) e 2- As 
before, ^eiifi ® g) have to extend P(b+i,i}- However, P(b+i,i} is incomparable with P(b+i,o)- Hence, we 
have ei + eg. Again take an initial segment cri c f\ extending ctq and determining O^,, (cri ®g) 2 p(b+i,i)- 
By iterating this procedure, we see that R requires at least b + I many indices e;. This contradicts our 
assumption. Therefore, R ^^'^ Zb+i. □ 

Proof of Theorem 194. Let P, 2, and {Z^lggN be n° sets in 195. Fix {a,IS) £ {(1,< w),(l,t^| < 6d),(< 
w, 1)). To see is not Brouwerian, it suffices to show that there is no (a,y6)-least R satisfying Q <^ P®P. 
If R satisfies Q P ® R, then clearly R e S{P, Q) since <^ is stronger than or equals to <^'^. Then, 
R i'^ Ze for some e e N. Moreover, € J?l(P, Q) implies Q P ®Ze, since <^ is weaker than or 
equals to <^^. Hence R is not such a smallest set. By the same argument, it is easy to see that is not 
Brouwerian, since Z^ is H^. □ 

Theorem 196. T)"^^ and are not Brouwrian. Moreover, the order structures that are induced by 
(^(N^^), <xO-lem) ^"'^ (^^^ of all nonempty 11^ subsets of 2^, <xO-lem) '^^^ ""^ Brouwrian. 

Lemma 197. Let {S ,},<„ be a collection o/H^ subsets o/2^ with the property for each i < n that IJ^,^,- S k 
has no element computable in x, G Si. Then, there is no {n, a))-computable function from T,<„5',- to 

Proof. Assume the existence of an («, 6(j)-computable function from T,<„5',- to 5, which is iden- 
tified by n many learners {^,),<„. Let P, be a partial («, (x>)-computable function identified by ^, i.e., 
Fi{x) = <l>iim„'P(.vi-n)W- Note that T,<„5', c |Jj<„ dom(P,). For each / < n, put D,- = dom(P,) n 
Pr^(^.^^ Si). Let Tsj denote the corresponding tree for 5;, for each / < n. Define S^ for each E Qn+\ 
to be the set of all infinite paths through the following tree Te. 

■«rf(---Ker^Ljrf ])...)). 



Here, T 




some finite subtree of T^', otherwise. 



Here, the choice of "some finite subtree of P^ depends on the context, and is implicitly determined 

1^ is a closed subset of T,<„S,. Divide S^^^^ 



when E is defined. For each E c n + I, clearly SZ is a closed subset of T,<„S,. Divide S^ , into n + I 



many parts {5'*),<„, where S^^^ is equal to [Ji<nS*, and each S* is degree-isomorphic to Si. 

For each / < n, check whether there is a string cr extendible in 5^, , such that 5"^, , n D,- n \cr] is 
contained in 5* for some j < n. If yes, for such a least / < n, choose a witness ctq - cr, and put Aq = {/}, 
and Bq = {j}. Then, for such j e Bq, "some finite subtree of T^^'" is choosen as the set of all strings rj 

used in o"o as a part of T^^' in the sense of the definition of T,<„5;, or successors of such n in P"'. Note 

■•9 



that ctq is also extendible in Inductively, for some s < n assume that as, A^, and B^ has been 

already defined. For each / ^ A^, check whether there is a string cr D cFs extendible in S'^^^^^-^^^ such that 
'^0!+i)\B ^ ^' ^ t*^] contained in 5* for some j i B^. If yes, for such a least / ^ As, choose a witness 
ctq = o", and put A^+i = As U {/), and Pj+i = ^.v U {j). As before, for such j e P.v+i» "some finite subtree 
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of Tj^'" is choosen as the set of all strings rj used in 0-^+1 as a part of T^^', or successors of such 77 in 
Note that ctc+i is also extendible in 5? , „ .If no such / ^ A, exists, finish our construction of cr, A, 
and B. Then, put A = A^, B - Bs, and define cr* to be the last witness (t^ . 

Put A" ^ « \ A and B" ^ (« + 1) \ B. Note that #A" + 1 = #B', since #A = #B. Therefore, B contains 
at least one element. By our assumption, for any x e [cr*] + 0, we must have Fiix) e ®,<„ 5,- for 
some / e A". Thus, A~ is nonempty. 

Fix a sequence a e {/Cf^ such that, for each / e A", there ai^e infinitely many n e N such that 
a{n) = i. First set tq - cr* . Inductively assume that 3 cr* has been already defined. By our definition 
of cr*, A and B, if ^ extends cr*, then the set n Da{s) n [^] intersects with S* for at least two j e B'. 
Therefore, we can choose x e S^- D Da(s) ^ [Ts] n S* for some j e B". Then, Fq,(v)(a;; 0) = 7, by our 
assumption of {S' ,■),<„. Find a string r* such that c r* c ;c and FQ,(i.)(T*; 0) = j. Again, we can choose 
X* e n Dais) n [t*] n S* for some k e B' \ {j}. Then, we must have Fa(s)(x*;0) = k t j. Let t^+i 
be a string such that r* c Ts+\ c x* and Ftt(i)(Ts+i;0) = k. Therefore, between and t^+i, the learner 
*Ftt(s) changes his mind. 

Define j = lj.s '^s- Then y is contained in since is closed. However, for each / e A", by our 
construction of y, the value Ffy) does not converge. Moreover, for each / ^ A", by our definition of A, 
B, and cr* c j, even if Ffy) converges, f,(y) ^ ©/<„'^!- Consequently, there is no («, a>)-computable 
function from T,<„S,- D 5'^_ to 5/ as desired. □ 

Put J{P, Q) = {R QM^ : Q <^o.^_^f^ P O R], and 'KiP, g) - {/? c : 2 <<'^ P ® /?}. Note that 
J^iP, Q) £ "^^CP 2)- Then we show the following lemma. 

Lemma 198. There are sets P,QQ 2^, and a collection {Z^leeN of subsets of 2^ such that 
Zg e J'CP 2), that, for every R G "KiP, Q), we have R Zefor some e eV^. 

Proof. By Jockusch-Soare's theorem 69, we have a collection of nonempty subsets of 2^ such 

that Xyt ^ j^f^ for any choice x; e Si, i e N. Consider the following sets. 

P = CPA~{S<e_o> ▼'5' <£,!>▼ ■ ■ ■ (e^e)}ee'N, Zg = S(e,g+i), 

5 (ej) ® Zg, if / < e, 

{P\[pe])^Ze, if/ = e+l, 

0, Otherwise. 



Q ^ CPA"{2„}„6N, where Q(^,j) 



Here, pe is the e-th leaf of the corresponding computable tree Pcpa for CPA. To see Z^ e J'iP, Q), for /© 
g € P®Ze, by using Z*'-LEM, check whether / does no extend p^. If no, outputs Pe,e+i ~(/©g). If / extends 
Pe, it is not hard to see that an finite iteration of E2-LEM can divide {pe~S {efiy'^S {e^\)y . . . (e,e)) ® Zg 

into [S (e,i)®Ze}i<e. 

Fix R € 7C(P Q). As Q P®R, some {b, a>)-computable function F maps P®P into 2- Suppose for 
the sake of contradiction that R <^ Z^. Then, for any h € Z/,, we have g e P with g <t h. Then, F maps 
(Pn[pfo])(g»{g} into 2n(U,<foP<fo,r>) by our choice of {S„]new Note that {Pr\[pb\)®[g} =\ (T,<foS<^,,>)®{g}, 
and 2 1^ (Ur<foP<fo,o) =1 (®,</, <«,'■>) ® Therefore, by Lemma 197, F is not {b, tL»)-computable. □ 

Proof of Theorem 196. Let P, 2> and {Zg)egN be Hj sets in 198. Then, by the same argument as in the 
proof of Theorem 194, it is not hard to show the desired statement. □ 

Corollary 199. If{a,p) € {(1, 1), (1, cd), (0^, 1)}, and{y,5) € {(1,< oj),{\,co\ < co),{< co,\),{< co,aj)}, 
then, there is an elementary difference between and 2)^, in the language of partial orderings {<). 

Proof. By Medvedev's Theorem 3, Muchnik's Theorem 5, and Proposition 41, the degree structures 

and iy( are Browerian, i.e., they satisfy the following elementary formula i/r in the language of 
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partial orders. 

ijj = (Vp, q)(3r)0/s) {p < qM r &. {p < qV s r< s)). 

Here, the supremum V is first-order definable in the language of partial orders. On the other hand, by 
Theorem 194 and 196, D<^, i)oj\<oj, 'D'^'^, and are not Brouwerian, i.e., they satisfy -n/^. □ 

5.6. Borel Measurability, and Backtrack Games. Berardi-Coquand-Hayashi [5] showed that a 1- 
backtrack Tarski game provides a semantics of positive arithmetical fragment of Limit Computable Math- 
ematics (i.e., Aj-mathematics, in the sense of Kleene realizability). 

Theorem 200 (Berardi-Coquand-Hayashi [5]). A positive arithmetical formula A is true in the Limit 
Realizability Interpretation if and only if the 3-player has a computable winning strategy in the 1- 
backtracking game bck(^(A)) associated with the Tarski game for A (for notations, see [5] j. 

Meanwhile, in the study of Wadge degree. Van Wesep [73] introduced backtrack game, and Andretta 
[3] used this game to characterize the A^ functions (also called the first level Borel functions) on Baire 
space N^. 

Definition 201. Fix any countable ordinal ^ < a)\, and a function / on Baire space N*^. 

(1) / is AJ if the preimage f-^{A) is 2:° for every 2° set A c N^. 

(2) / is H^-measurable if the preimage f'\A) is for every E° set A c N^. 

Clearly, every A° function on Baire space is 2I°-measurable. The effective hierarchy of Borel 
measurable functions is studied by Brattka [10]. However, in general, an effective measurable func- 
tion is not nonuniformly computable. For example, an effectively -measurable function can map a 
computable point to a point of Turing degree 0^"\ Indeed, the class of (effectively) E^-measurable func- 
tions does not closed under composition, in general, whereas the class of A^ functions must be closed 
under composition. Our piecewise computability theorem 156 suggests that our notions of learnability 
is not like the effective E°-measurability but more like effective versions of A^ functions, because of the 
following observations. 

Definition 202. Let / be a partial function on Baire space N^, and F (resp. F) be a boldface (resp. 
lightface) pointclass. 

(1) / is T-piecewise continuous if there is a F partition {2,},gN of dom(/) such that / [ Qi is 
continuous for each / e N. 

(2) / is T-piecewise computable if there is a F partition (GilieN of dom(/) such that / [ Qi is 
computable uniformly in / e N. 

Theorem 203. Let f:N^^n^be a function. 

(1) (Jayne-Rogers [42]) f is if and only iff is Il^-piecewise continuous. 

(2) (Semmes [59]) f is A^ if and only iff is Xi^-piecewise continuous. 

Proposition 204. Let P and Q be any subsets of Baire space N^. 

(1) A function f : Q ^ P is {l,a>)-computable if and only if f is Il^-piecewise computable. 

(2) Whenever P is 11 j, an (o), \)-computable function f ' Q ^ P exists if and only if a Il^-piecewise 
computable function f*'Q^P exists. 

Proof. By analyzing the proof of Theorem 156. □ 

Actually, our dynamic models directly fit into the backtrack and multitape game characterization of 
subclasses of Borel measurable functions. We now introduce various games based on the Wadge game, 
the backtrack game, and the multitape game. 
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Definition 205. Fix a partial function / on N , and a set X which has no intersection with N. The set X 
may contain pass, back, (move,/) for each / e N. Then, we introduce various two-players games on / 
as follows. At every round n eM, Player I chooses an element x„ e N, and Player II chooses an element 

J,, e N U X. 

I: xq x\ Xi 

11: Jo y\ yi ■■■ 

Apair of infinite sequences {x,y) € N^x(NuX)^ is called a play. Fix aplay {x,y), where x - {xn)neH 
and y = {yn}nehh We say that Player I violates the basic rule if x ^ dom(/), and that Player II violates the 
basic rule if either j,, e {pass, (move, /) : / e N) for almost all « 6 N, or y,, - back for infinitely many 
« G N. We also say that Player II violates the rule m if y contains at least m many back's, and violate 
the rule * if there is an infinite increasing sequence (m(?i))„gig of natural numbers with y,n(n) = (move, /„) 
and in+i t in for any n e N. For each / € N, the i-th content of the play y of Player II is a function 
content,- : (N U Xf^ — > which is inductively defined as follows. Set content;(()) = () and 
tape(()) = 0. Assume that content;(y \ n) and tape(3' \ n) have been akeady defined for each / e N. 

content;(y I n + 1) 



tape(y I n + I) 

Then, for each / £ N, we define content,(y) = lim,igN content,(y [ n) for any j e (N U X)^. We say 
that Player II wins (resp. is winnable) on the play {x,y) 6 x (N U X)^ of the game G{f,X) if either 
Player II does not violate the basic rule, and f{x) - content;(j) for the least / e N with content,(y) 
being total (resp. for some / e N), or Player I violates the basic rule. We also say that Player II wins 
(resp. is winnable) on the play {x,y) of the game G,„{f,X) if Player II wins (resp. is winnable) the game 
G{f,X) and does not violate the rule m, and that Player II wins (resp. is winnable) the game Gt{f,X) if 
Player II wins (resp. is winnable) the game G{f,X) and does not violate the rule *. 

A strategy of Player II is a function i// : ^ (N U X)<^ such that \i//{o-)\ = \o-\ for each cr e oj'^'^, 
and tfricr) c (/^(r) whenever o" c t. A strategy tA of Player II is winning (resp. winnable) in the game G if 
Player II wins (resp. is winnable) the game G on the play {x, i/'(jc [ n)) for any x £ N^. 

We write P, B, and Mq, for {pass}, {back}, and {(move, /) : / < a], respectively, for each a < oj. Then, 
for S, T, U e {P, B, Ua}a<a), the union S U T U U is denoted by STL). 

Remark. The games G{f, P), G{f, PB), and G{f, PM^) are essentially same as the Wadge game, the 
backtrack game, and the multitape game, respectively. For original definition of variations of Wadge 
games, see also Motto Ros [51] and Semmes [59]. 

Theorem 206. Let f be a partial function on Baire space N^. 

(1) (Wadge [74]) / is continuous if and only if Player II has a winning strategy in the game G{f, P). 

(2) (Andretta [3]) / is if and only if Player II has a winning strategy in the game G{f, PB). 

(3) (Andretta, Semmes [58]) / is JJ^-piecewise continuous if and only if Player II has a winning 
strategy in the game G{f, PM^^). 

Theorem 207 (Game representation). Let f be a partial function on Baire space N^. 

(1) f is (l, \)-computable if and only if Player II has a computable winning strategy in the game 
G(f, P). 

(2) / is {\,m)-computable if and only if Player II has a computable winning strategy in the game 
G„,{f, PB). 



content,(y [ n)~{y„} if y,, eM & i = tape(y [ n), 
if yn = back & / = tape(j I n), 

content,(y [ n) otherwise. 

/ if yn = (move, /), 

tape(y [ n) otherwise. 
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(3) / is (1, cj\m)-computable if and only if Player II has a computable winning strategy in the game 
G,{f, PMm). 

(4) / is {\,(jj)-computable if and only if Player II has a computable winning strategy in the game 
G{f, PB). 

(5) / is (m, \)-computable if and only if Player II has a computable winnable strategy in the game 
G{f, PM„). 

(6) / is (m, a))-computable if and only if Player II has a computable winnable strategy in the game 
G{f, PBM,„). 

(7) / is {oj, \)-computable if and only if Player II has a computable winnable strategy in the game 
Gif, PMJ. 

Proof. (1,3) We need to construct a winning strategy if/ : N^^ — > (N U {pass, back))*^^^ from a given 
partial (1, 6ij)-computable function / :C — > N'^. Assume that / is (1, aj)-computable via a learner 
*F. We inductively define a strategy : N"*^ ^ (N U {pass, back))*^^ and an auxiliary parameter 
T] : N'^'^ ^ (N U {back})'^^. Set = ?]{{)) = <), and assume that and 77(0-") have been already 

defined. If 'F(o-) = "¥(0--), then set ?/*(cr) = r]{o--yT, where (Dvp(^)(o-) = Ovp(^)(o--)~T. If 'F(o-) i= *F(o--), 
then set ?7*(cr) = 77(cr~)~back~<l)ij/(o-)(cr). From the parameter ri^{cr), we define ipicr) as follows. If 
'7*(o") = (>, then if/{cr) = (/'(o-~)~pass, and 77(0") = /7«(o-)- If ?7*(o") ^ (), then (/^(cr) - i//{o-')~r}^{cr)(0), 
and riio-) = shH?7*(cr)). Note that {« € N : (U/t t k)){n) = back} ^ {n 6 N : I n + l)i='i'{x t n)} 
for any x 6 dom(/). It is easy to see that (A is a computable winning strategy in the game G(/, PB). 

Assume that a computable winning strategy >p* in the game G(/, PB) is given. We consider the com- 
putable function if/{cr) = contento(i/'*(cr)). Then {« e N : i^(x [ n + I) \fj{x \ n)) is finite, for any 
X e dom(/), since Uhsn \ ") contains finitely many back's. Moreover, f{x) = lim„ if/{x [ n). Thus, 
by Proposition 42, / is (1, (x>)-computable. 

(2) By Theorem 178 (2), if / is (1, (jj|m)-computable, then / <w UniqueS2-LLP0„,. Assume that we 
have computable functions // : ^ {M^T and ii: : x m ^ satisfying f{x) - K{x, G o H{x)) for 
any x e dom(/), for the unique realizer G of UniqijeX2-LLP0m. For each cr £ N*^^, the /-th coordinate 
of //(cr) is denoted by Hi{cr), i.e., //(cr) = {Hi{cr))i^,„. We inductively define a strategy ifr : N"^^ 
(N U {pass, (move, : / < m})'^'^ and an auxiliary pai^ameter 77 : N'^'^ ^ (N U {(move,/) : / < m})"^-^. 
Set (/'(()) = r]({}) = (), and assume that ipio-") and ?7(cr") have been already defined. We pick the least 
/ < m such that y,- contains 0, where //,(cr) = Hi(cr^)~yi. Then, we set 77*(cr) = T]{cr^)~ {move, i)~T, 
where K(x, i) = content,(i^(cr~))~T. If there is no such / < m, then we set 77,(0") = r}{o-~). From the 
parameter 77,(0-), we define i/r(cr) as follows. If 77,(cr) - <), then i/'(cr) = t/^(cr")~pass, and 77(0") - t]^{o-). 
If 77,(0-) ?t (), then >]/{cr) - 4f{a-~)~rit,{cr){Q), and 77( cr) - sh' (77,(0-)). For any x e dom(/), if G o H{x) = i, 
then Hk{x) contains only finitely many O's for any k t i. Therefore, ^{x) = |J„ ifr{x [ n) contains 
infinitely many (move, /)'s, and only finitely many (move, 7)'s for any k 4^ i. Therefore, x^j does not violate 
the rule *, and we observe that content,- o \p{x) = K(x, i) = K{x, G o H{x)) = f{x). Hence, i/' is a winning 
strategy in the game G,(/, PM,,,). 

Assume that a computable winning strategy ip* in the game G,(/, PM,,,) is given. Let e{i) be an index 
of a partial computable function x i-> content,- o tp*{x) for each / < m. Since \fj* does not violate the rule 
*, there is a unique / < m such that Oj,(,-) - content, o ip*{x) is total, for any x € dom(/). We inductively 
define a leai^ner The learner *F first guesses *F(()) = e(0). Set ^(cr) - *F(cr^) when there is no / < m 
such that |<l>e(,-)(cr)| > |<l)g(,-)(o-")|. Otherwise, for the least such / < m, the learner guesses ^(cr) = e{i). 
Clearly, #{*F(a; \ n) : n e M\ < m for any x € N^. It is easy to check that, for any x e dom(/), 
lim„ ^{x \ n) converges to e{i) for the unique / < m ensuring the totality of content,- o ip*(x), and, for 
such / < 771, we have (^iim„w{xtn)ix) = content,- o tf/*{x) = fix). Consequently, / is (1, a>|77i)-computable. 

(4,6) For a given collection {0,-),-g/ of partial computable functions, we can easily construct a strategy 
i// : N*^-^ ^ (M U {pass, (move, /) : / € /}) ensuring content,- o i^{x) - 0,-(;c) for any x e N^. Therefore, 
/ is nonuniformly computable via {<!>,- then ifr is winnable in G{f, PM/). Conversely, if a winnable 
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Strategy ijj : N ^ (N U {pass, (move, /) : / e /}) of the game G{f, PM/) is given. Then we consider the 
partial computable function F,- computing r,(x) - content,- o i/^(x) for any x e N^. It is easy to see that 
/ is nonuniformly computable via {r,};g/. 

(5) By combining the proofs of the items (3) and (4), it is not hard to see the equivalence of the 
(m, a»)-computability of / and the computable winnability in the game G{f, PBM„,). □ 

Remark. We may introduce more general multitape games based on our dynamic tape models, and 
nested (nested nested, nested nested nested, etc.) tape models. 

5.7. Open Questions. 
Question 208 (Small Questions). 

(1) Determine the intermediate logic corresponding the degree structure DIj, where recall that D} 
and are exactly Jankov 's Logic. 

(2) For every set Q <} CPA~CPA, does there exist nonempty 11° sets Po,Pi £ 2^ such that 

(3) Does there exist a special ITj set P c 2^ and a notation omega e O of order type oj satisfying 

p -1 p(omega) ^ 
^ —<(ij ^ 

(4) Does there exist IIj sets P,Qc2^ with P <lj Q such that there is no \a\-bounded learnable 
function F : 2 — > P for any a e O? For a 11^ set P in Theorem 117, does there exist a function 
r : P ^ P (1, co)-computable via an \a\-bounded learner for some notation a e O? 

(5) Does there exist a pair of special 11^ sets P,Qq2^'^ with a function T : Q^P — > Q® P (or 
r : QVoo ~^ Q ® P) which is learnable by a team of confident learners (or a team of 
eventually-Popperian learners ) ? 

(6) LetPo, Pi, Qo, and Qi be Y]P^ subsets of 2^ with Qo <l Qi and Pq <l Pi- Then, does Pof°Qo <l 
PiT°2i hold? Moreover, if Qo <i, Qi is witnessed by an eventually Lipschitz learner, then does 
Pq^Qo <lPiyQihold? 

(7) Does there exist IIj sets P,Qc2^ such that there is a computable functions F,- '. Qi ^ P with 
a finite 11° d-layer {2/},<,„ of Q, but is no computable functions A,- : Qi ^ P with a finite 11° 
cover {Qi}i<m of Q? In other words, does there exist 11° sets P,Qc2^ such that P Q and 
P Q? 

(8) Determine the strength of the existence of computable functions '■ Qi ^ P with a 11° cover 
{Qi]im of Q, for any n° sets P,QQ 2^. In other words, compare the reducibility and other 
reducibility notions (e.g., <^'^, <l^^, <^nd <lj)for n° subsets of Cantor space 2^. 

Question 209 (Big Questions). 

(1) Are there elementary differences between any two different degree structures and 
CP" and V"' ) ^ 

(2) Is the commutative concatenation V first-order definable in the structure 2)j or 7 

(3) Is each local degree structure 'P^|^ first-order definable in the global degree structure 

(4) Is the structure V\j dense? 

(5) Investigate properties of {a,p\y)-degrees a assuring the existence o/b > a which has the same 
(a' ,/^'\y')-degree as a. 

(6) Investigate the nested nested model, the nested nested nested model, and so on. 

(7) Does there exist a "natural" intermediate notion between (< aj,co)-computability (i.e., team- 
leamability) and (oj, \)-computability (i.e., nonuniform computability) on n° sets? 

(8) (Ishihara) Define a uniform (non-adhoc) interpretation (such as the Kleene realizability in- 
terpretation) translating each intuitionistic arithmetical sentence (e.g., (-'-'3nVmA{n, m)) — > 
{3nimA{n,m))) into a partial multi-valued function (e.g., E°-DNE :C =| N^j. 
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